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Introduction 


Most  of  us  are  familiar  with  queueing  for  service  in  one  form  or  another:  obvious 
examples  are  the  lines  at  a  checkout  in  a  supermarket  and  at  a  cashier’s  window  at 
a  bank.  Others  include  waiting  on  ‘hold’  to  get  through  to  somebody  on  the 
telephone,  circling  in  a  jet  over  Heathrow  waiting  to  land,  and  waiting  for  a 
hospital  bed  to  become  available.  Sometimes  the  size  of  the  queue  is  apparent, 
sometimes  not;  sometimes  it  is  possible  roughly  to  forecast  the  time  one  is  likely  to 
have  to  wait,  sometimes  not;  there  are  times  when  one  does  not  have  to  wait  at  all, 
and  there  are  times  when  the  queue  is  so  long  that  one  is  put  off,  and  goes  away 
to  do  something  else  instead,  taking  no  further  part  in  the  queueing  process. 

Some  of  us  will  have  experienced  the  queue  from  the  server’s  side  of  the  counter,  in 
which  case  one  might  be  more  concerned  about  the  incidence  of  breaks  (when 
nobody  is  queueing)  or  about  the  possibility  that  customers  will  arrive  so  rapidly 
that  one  is  eventually  overwhelmed. 

Both  servers  and  customers  suffer  from  the  unpredictability  of  the  whole  affair. 

One  customer  is  finished  in  a  minute,  another  (normally  the  one  just  in  front  of 
you)  takes  hours.  The  phenomenon  is  one  which  it  would  be  interesting  to  model 
as  a  random  process,  both  because  queues  are  so  common,  in  all  sorts  of  different 
contexts,  and  because  it  would  be  enlightening  to  understand  their  structure.  In 
addition,  some  queueing  features  can  be  independently  controlled  —  one  might  try 
timetabling  arrivals,  or  increasing  the  number  of  service  points,  or  changing  the 
service  mechanism,  and  it  would  be  useful  to  know  the  consequences  of  such 
alterations. 

Obviously,  there  are  many  features  which  one  could  include  in  a  queueing  model, 
and  some  very  sophisticated  models  have  been  developed.  Essentially,  however, 
there  are  just  three  main  aspects  of  the  process  which  must  be  attended  to.  The 
first  is  the  arrival  mechanism.  For  instance,  do  customers  arrive  singly,  or  should 
the  model  allow  for  the  simultaneous  arrival  of  groups  of  several  customers?  Do 
they  arrive  in  a  haphazard  way,  or  by  appointment?  And  if  there  is  an 
appointment  system,  are  customers  punctual?  The  answers  to  such  questions  will 
dictate  what  sort  of  mathematical  construction  to  use.  The  second  feature  to 
determine  is  how  best  to  represent  the  service  time.  There  is  usually  some  random 
component  in  this,  but  it  could  be  constant,  or  sensibly  modelled  as  such  —  for 
instance,  when  the  service  consists  of  withdrawing  cash  from  an  automated  cash 
dispenser.  Finally,  one  needs  to  specify  the  number  of  servers.  There  is  always  at 
least  one;  often  there  are  several;  in  some  circumstances  the  number  is  variable. 
Clearly,  if  service  can  take  place  as  a  parallel  scheme  rather  than  just  sequentially, 
this  will  have  a  considerable  effect  on  the  queue.  We  shall  return  to  these 
fundamentals  shortly. 

There  are  other  considerations,  and  one  in  particular  is  the  queue  discipline,  which 
deals  precisely  with  the  manner  in  which  customers  reach  the  service  point.  For 
instance,  are  they  served  in  the  order  in  which  they  arrive?  In  many  cases  this  will 
happen,  but  not  always.  Returned  library  books  might  be  piled  up  on  top  of  one 
another:  then  the  last  one  returned  will  be  the  first  to  be  replaced  on  the  shelves. 
Sometimes  selection  of  the  next  customer  might  seem  to  be  at  random,  or  even 
dependent  on  some  other  random  variable  having  nothing  at  all  to  do  with  the 
time  of  arrival  —  for  instance,  a  nervous  barman  might  serve  the  man  at  the  bar 
with  the  loudest  and  most  unpleasant  voice;  or  it  might  in  another  context  be  a 
case  of  ‘ladies  first’.  If  there  is  more  than  one  server,  then  it  is  a  matter  of  some 
significance  whether  there  is  a  single  central  queue,  as  at  many  banks  and  post 
offices,  or  whether  the  queueing  mechanism  is  multi-channel  (effectively,  several 
queues  operating  independently),  as  it  tends  to  be  at  a  supermarket.  If  the  queue  is 
multi-channel,  then  moving  from  line  to  line  to  take  advantage  of  a  real  or 
imagined  variation  in  congestion  might  be  a  possible  strategy.  The  whole  matter  of 
queue  discipline  is  a  topic  whose  ramifications  it  would  be  very  interesting  to 
study;  however,  throughout  this  unit  we  shall  always  assume  that  customers  are 
served  in  the  order  in  which  they  arrive.  That  is,  if  there  is  more  than  one  server, 
then  we  shall  always  assume  that  a  central  queueing  system  is  in  operation,  and 
that  customers  move  forward  as  servers  become  free. 
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In  this  unit,  we  shall  therefore  be  dealing  essentially  only  with  the  different  sorts  of 
models  that  can  be  constructed  by  varying  the  three  features  of  arrival  mechanism, 
service  time  distribution  and  server  availability.  In  Section  1  we  shall  study 
possibly  the  simplest  queue  of  all:  where  arrivals  occur  singly,  independently  of 
one  another,  and  at  random;  where  service  is  provided  at  a  single  service  point; 
and  where  the  service  time  is  exponential.  (Actually,  in  general  in  this  unit,  it  will 
be  supposed  that  arrivals  occur  singly,  rather  than  simultaneously  in  groups  of  two 
or  more,  and  that  these  arrivals  occur  at  random.) 

After  ‘a  long  time’,  one  of  two  things  will  have  happened  to  this  queue.  Either  the 
server  is  coping,  and  will  be  happily  processing  customers  through  the  system,  or 
customers  will  be  arriving  at  an  average  rate  too  fast  for  the  server  to  attend  to 
them.  In  the  former  case,  the  queue  is  said  to  have  attained  steady  state,  or  to  be 
in  equilibrium.  In  the  latter  case,  the  queue  will  tend  to  get  longer  and  longer, 
overwhelming  the  server.  In  Section  2  we  shall  examine  the  conditions  under 
which  the  two  types  of  long-term  behaviour  occur. 

Section  3  generalizes  the  model  to  a  multi-server  queue,  and  ends  with  a 
description  of  the  infinitely-many-server  queue,  a  model  with  some  surprising 
applications.  In  Section  4,  the  service  time  distribution  is  generalized  to  include 
cases  other  than  the  exponential,  and  you  will  see  what  effect  this  has  on  the 
queue.  In  particular,  we  shall  model  the  case  of  constant  service  time. 

Finally,  a  few  particular  alternative  models  will  be  described,  though  not  in  any 
great  detail.  They  include  the  case  of  an  appointment  system  for  arrivals,  the 
situation  where  arrivals  are  put  off  by  a  long  queue  and  go  away  without  joining 
it,  and  some  generalizations. 

None  of  the  sections  is  particularly  long;  if  for  some  reason  it  turned  out  to  be 
convenient  for  you  to  do  so,  you  could  read  Section  4  before  reading  Section  3, 
but  they  would  both  take  about  the  same  amount  of  study  time.  There  is  a  video 
session  —  Band  E  —  at  the  end  of  Section  4;  you  should  allow  15  minutes  for  it. 
There  is  no  audio  component  associated  with  this  unit. 

The  unit  relies  to  a  great  extent  on  the  material  covered  in  Unit  8  —  indeed,  a 
queue  may  be  regarded  as  a  special  case  of  the  birth  and  death  process,  with 
arrivals  constituting  ‘births’  and  departures  ‘deaths’.  This  approach  will  be  dealt 
with  in  detail  here,  but  you  might  find  it  useful  to  revise  Unit  8,  Subsections  1.2 
and  1.3,  before  you  start  this  unit. 


1  The  simple  queue 


One  of  the  simplest  queueing  models  to  describe  is  one  in  which  customers  arrive 
singly,  independently  of  one  another  and  at  random  (and  not,  for  instance,  by 
appointment,  or  in  groups  of  two  or  three);  where  there  is  a  single  queue  forming 
up  in  front  of  a  single  server  (not  like  most  banks  or  post  offices,  where  there 
might  be  four  or  five  tellers  on  duty);  and  where  the  time  taken  to  serve  a 
customer  —  the  service  time  —  is  a  random  variable  with  a  known  and  completely 
specified  distribution.  In  this  section,  for  the  sake  of  simplicity  we  shall  further 
suppose  that  the  service  time  probability  distribution  is  exponential.  (This  means 
that  a  new  arrival,  concerned  about  how  long  he  will  have  to  wait  for  service,  need 
not  worry  about  how  long  the  customer  currently  receiving  attention  at  the  head 
of  the  queue  has  been  there,  since  the  exponential  distribution  has  the  memoryless 
property.  That  customer  can  be  regarded  as  having  just  moved  into  position,  and 
his  service  time  as  only  just  starting.) 

If  we  can  construct  a  mathematical  model  of  this  situation,  then  we  shall  be  able 
to  answer  questions  about  queue  size,  waiting  times,  long-term  properties  of  the 
queue,  and  so  on.  It  would  be  sensible  to  start  with  something  familiar:  we  could 
try  to  find  the  distribution  of  the  queue  size  at  time  t,  conditional  on  some  stated 
initial  size  —  this  would  be  to  follow  the  sort  of  approach  taken  in  Units  7  and  8. 
First,  a  more  precise  description  of  the  queue  is  given. 


In  this  unit,  the  use  of  the  pronoun 
‘he’  should  be  interpreted  as  relating 
to  either  a  male  or  a  female. 


4 


1.1  Description 

The  sort  of  queue  that  we  shall  model  operates  as  follows. 

Suppose  that  individual  customers  arrive  at  the  service  point  independently  of  one 
another,  and  entirely  unpredictably:  the  mathematical  way  of  setting  this  up  is  to 
model  their  arrivals  as  a  Poisson  process  in  time,  with  average  arrival  rate  X.  For 
instance,  at  a  village  shop,  this  arrival  rate  might  be  of  the  order  of  20  per  hour, 
whereas  it  might  be  something  like  two  ‘customers’  per  day  at  the  village  police 
station.  To  put  it  another  way,  the  distribution  of  the  inter-arrival  time  is 
exDonential  with  parameter  X.  We  can  regard  this  arrival  mechanism  as  an 
immigration  process,  a  particular  case  of  the  birth  and  death  process  discussed  in 
Unit  8. 

In  many  cases  the  Poisson  arrival  pattern  is  probably  not  a  bad  representation  of 
real  life.  People  do  tend  to  turn  up  to  banks,  supermarkets  and  so  on  without 
much  regard  for  what  other  customers,  total  strangers,  might  have  decided  to  do. 
Situations  where  the  Poisson  process  would  not  be  a  good  start  to  developing  a 
queueing  model  include  a  doctor’s  or  a  dentist’s  surgery,  where  arrivals  tend  to 
occur  according  to  an  appointment  system  and  so  would  be  roughly  regular,  and  a 
cinema  ticket-office,  where  arrivals  would  cluster  around  some  instant  of  time, 
perhaps  20  minutes  before  the  scheduled  start  of  the  film. 

If  the  server  is  free,  then  an  arriving  customer  goes  straight  to  the  head  of  the 
queue  and  is  served  immediately.  If  the  server  is  busy,  then  the  new  customer  has 
to  join  the  end  of  the  queue,  and  wait  while  earlier  customers  are  served  before  he 
can  be  served.  However,  the  order  of  serving  is  strictly  that  of  arrival  —  we  speak 
of  the  queue  discipline  as  first-come-first-served,  or,  which  amounts  to  the  same 
thing,  first-in-first-out.  After  a  customer  is  served,  he  leaves,  and  plays  no  further 
part  in  the  exercise. 

For  a  customer  who  does  have  to  wait,  the  more  customers  there  are  preceding 
him  in  the  queue,  the  longer  this  waiting  time  will  be;  but,  of  course,  his  actual 
service  time  will  still  be  just  a  single  observation  from  the  service  time  probability 
distribution.  The  total  time  spent  in  the  queue  from  the  moment  of  his  arrival  to 
the  moment  of  departure  is,  in  any  case, 

queueing  time  =  waiting  time  +  service  time, 

where  waiting  time  is  simply  the  time  taken  to  complete  the  service  of  any 
customers  preceding  him  in  the  queue  when  he  arrives;  if  there  are  none,  then  the 
waiting  time  is  zero,  and  queueing  time  and  service  time  are  one  and  the  same. 

Now  suppose  that  the  service  time  has  an  exponential  distribution.  This  means 
that  (except  for  those  periods  of  time  where  the  server  is  free,  or  ‘idle’)  customers 
not  only  arrive  according  to  a  Poisson  process,  but  also  exit  according  to  a 
Poisson  process,  characterized  as  it  is  by  exponential  gaps.  Again  we  can  regard 
this  in  terms  of  the  birth  and  death  process  described  in  Unit  8 ,  as  a  particular 
instance  of  an  emigration  process,  and  write  the  emigration  rate  as  s.  To  put  it 
another  way,  the  mean  of  the  service  time  T  is  ptT  =  1/e,  and  we  can  write 
T  ~  M(e).  We  refer  to  the  parameter  e  as  the  service  rate  for  the  queue;  for  this  is 
the  average  rate  at  which  a  server  (as  long  as  there  are  customers  there  to  serve) 
deals  with  customers. 

This  service  time  distribution  is  probably  the  least  representative  element  of  the 
simple  model.  It  really  is  rather  difficult  to  conceive  of  a  situation  where  the 
service  time  can  be  regarded  as  memoryless:  if  on  arrival  at  a  queue  at  a  post 
office,  say,  you  discover  that  the  person  at  the  front  of  the  queue  has  already  been 
there  ten  minutes,  you  might  reasonably  incline  to  the  view  that  he  cannot  be 
there  much  longer.  Further,  there  are  reasons  to  suppose  that  a  service  time 
probability  density  more  symmetric  than  the  exponential  distribution,  which  is 
very  skewed,  would  be  more  representative  in  most  situations.  Despite  these 
remarks,  this  simple  model  (incorporating  an  exponential  service  time  distribution), 
which  is  mathematically  tractable,  will  demonstrate  useful  principles  and 
conclusions  of  general  application. 


Over  an  extended  period  of 
observation  like  the  whole  of  the 
working  day,  it  might  be  that  a 
better  model  for  the  arrivals  would 
be  a  non-homogeneous  Poisson 
process.  Then  the  arrival  rate  could 
be  varied  to  reflect  peak  periods  and 
others  where  the  demand  for  service 
is  low'.  W&shall  not  discuss  this  sort 
of  model  in  this  course. 


The  idea  of  emigration  from  a 
community  was  mentioned  in 
Unit  8,  but  not  used  in  any 
particular  situation.  This  is  its  first 
application. 
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A  neat  way  of  characterizing  a  queue  has  been  developed  to  express  as  concisely 
as  possible  the  three  features  of  arrival  mechanism,  service  time  and  server 
number.  First,  the  inter-arrival  time  distribution  is  specified:  if  arrivals  occur 
according  to  a  Poisson  process,  then  this  distribution  is  exponential,  written  M ■ 

Other  examples  aic  u  (umtorm),  D  (deterministic,  corresponuing  to  a  fixed-interval 
appointment  system)  and,  in  general,  G.  The  same  applies  to  the  service  time 
distribution  —  M  in  this  simple  case,  D  for  constant  service  time,  and  so  on. 

Finally,  the  number  of  servers  is  specified.  The  model  we  shall  be  developing  in 
this  section  is  written  M/M/1,  because  the  arrival  process  is  Poisson  (M),  service 
times  are  exponential  (M)  and  there  is  a  single  server  (1).  The  model  M/M/1  is 
called  a  simple  queue. 

In  Section  3  we  shall  study  queues  where  the  arrival  mechanism  is  Poisson  and 
where  service  times  are  still  exponentially  distributed,  but  where  n  (>  1)  servers  are 
on  duty:  this  queue  has  the  specification  M/M/n.  In  Section  4  we  shall  first 
examine  the  M/D/ 1  queue,  and  then  take  a  very  brief  look  at  what  sort  of  progress 
can  be  achieved  without  making  any  assumptions  about  the  service  time 
distribution  in  a  single-server  queue  with  random  arrivals:  this  is  written  M/G/l. 

Question  1.1 

(i)  The  local  branch  of  one  of  the  clearing  banks  has  two  cash  dispensers  outside, 
neither  of  which  has  ever  been  known  to  break  down.  A  customer  who  arrives 
to  find  either  one  free  uses  it  immediately.  Otherwise,  a  convention  seems  to 
have  developed  that  customers  arriving  to  find  both  machines  busy  form  a 
central  queue  by  an  adjacent  litter  bin,  moving  forward  to  the  first  machine  to  Page  3 
become  available.  Assuming  that  it  alwavs  takes  the  same  amount  of  time  to 

use  the  machine,  and  that  customers  amve  at  random,  write  down  the 
specification  of  the  queueing  system. 

(ii)  Interpret  the  two  queue  specifications  (a)  M/U/6  and  (b)  D/D/2.  □ 

There  are  many  features  of  a  queue  in  which  one  might  be  interested:  the  general 
problem  is  one  of  ‘congestion’.  This  term  covers  such  aspects  of  the  queue  as 

— the  length  of  the  queue,  including  the  customer  currently  receiving  service; 

— the  time  spent  waiting  for  service; 

— the  total  time  spent  queueing; 

all  of  which  are  crucial  from  a  customer’s  point  of  view.  From  the  server’s  point  of 
view,  important  features  are 

the  duration  of  intervals  of  idleness,  when  no  customers  are  being  served  (and 
none  is  awaiting  service),  and  the  frequency  with  which  such  intervals  occur; 

— the  duration  of  periods  between  intervals  of  idleness  and  the  number  of 
customers  served  during  them. 

A  fundamental  issue  for  anybody  involved  in  the  operation  of  a  queue  is  the 
question  of  whether  the  queue  ends  up  getting  longer  and  longer,  swamping  a 
server  who  is  too  slow  to  cope.  Other  features  include  ‘operational’  considerations 
such  as  whether  or  not  it  would  be  economical  to  employ  extra  servers,  and 
whether  it  is  possible  to  ‘control’  the  service  mechanism  in  some  way  to  speed  up 
the  whole  process.  We  shall  look  at  some  of  these  features  now,  and  others  later. 


When  the  arrival  process  is 
deterministic,  there  is  no  random 
element  in  the  arrival  times. 

This  indicates  the  general  form  of 
the  notation  for  the  inter-arrival  and 
service  time  distributions  —  in  this 
case,  they  are  both  exponential.  It 
does  not  imply  that  the  parameters 
(X  and  e)  are  the  same. 


1.2  Queue  size 

One  of  the  simplest  variables  to  consider  is  the  length  of  the  queue  —  or  what  we 
shall  normally  refer  to  as  the  queue  size  —  at  time  t.  This  is  obviously  of  particular 
interest  to  an  arrival  at  time  t,  since  it  has  a  bearing  on  the  time  he  will  have  to 
spend  waiting  for  service.  Queue  size  is  an  integer-valued  continuous-time  random 
process,  which  we  shall  write  in  the  usual  way  as  { X{t );  t  >  0}.  Included  in  the 
count  is  the  customer  (if  any)  currently  at  the  head  of  the  queue  and  being  served. 
In  other  words,  X<t)  is  inst  the  ‘population  size’  at  time  f.  and  we  shall  attempt  to 
find  its  probability  distribution  in  the  usual  way,  according  to  the  methods  of 
Units  7  and  8. 
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We  shall  denote  by  px{t)  the  probability  P(X(t)  =  x)  that  the  queue  contains  exactly 
x  customers  at  time  t.  (Strictly  speaking,  assuming  that  at  time  0,  the  start  of 
observation,  the  queue  contains  2f(0)  =  x0  customers,  then  what  we  want  to  find  is 
the  conditional  probability  px{t)  =  P(X{t)  =  x  |  X(0)  =  x0).  However,  as  in  previous 
units,  the  initial  condition  is  not  explicit  in  the  notation  px(t).)  Then,  regarding  an 
arrival  as  a  ‘birth’  and  a  departure  as  a  ‘death’,  we  can  regard  the  simple  queue 
M/M/1  as  a  special  case  of  the  birth  and  death  process  of  Unit  8.  The  differential- 
difference  equations  for  the  sequence  of  probabilities  {px{t)}  for  the  birth  and  death 
process  take  the  form  (repeating  Unit  8  Equation  (1.7)) 


d 


JtPx(t )  =  Px-iPx-!{t)  +  vx+lPx+1(t)  -  (Px  +  vx)px{t),  x  =  0,  1,  2,...,  (1.1) 


where  =  p-x{t)  =  0  (by  definition). 


Question  1.2  Identify  the  parameters  /]x  and  v*  for  the  simple  queue.  □ 

The  arrival  rate  is  constant,  so  px  =  X  for  x  =  0,  1,  2,...;  if  there  is  nobody  in  the 
queue,  then  there  is  nobody  there  to  depart  having  received  service,  so  v0  =  0 
(v0  was  defined  to  be  zero  in  Unit  8);  and  when  there  are  customers  in  the  queue, 
there  is  still  only  one  server  attending  to  them,  so  v*  =  e  for  x  =  1,  2,...  .  This 
gives  the  complete  family  of  differential-difference  equations  for  the  simple  queue: 

jtPx(t)  =  Apx-1{t)  + epx+1(t)-(l  +  e)px{t),  x  =  1,2, ... ,  (1.2a) 


d_ 

dt 


Po(0  =  £Pi(0  -  ^Po(0- 


(1.2b) 


The  next  step  is  to  use  the  differential-difference  equations  to  establish  the 

corresponding  partial  differential  equation  for  the  probability  generating  function 

00 

n(s,t)  =  Yj  Px(0  sx  of  the  random  variable  X(t).  Following  the  usual  procedure,  we 

x=0 

obtain 


dU 

dt 


=  -(l  -s) 


n  +  -sp0(t) 


(1.3) 


You  are  spared  the  details. 


Now,  all  the  partial  differential  equations  that  we  have  met  so  far  in  the  course 
have  been  of  the  Lagrange  form 

jn  dn  , 

fJF  +  slt  =  h’ 

where  /,  g  and  h  are  functions  of  s,  t  and  n.  Here,  for  the  first  time,  we  have  an 
equation  not  of  this  form;  and  the  culprit  is  the  term  p0(t ),  the  probability  that  the 
queue  is  empty  at  time  t  (equivalently,  that  the  server  is  idle  at  time  t).  This 
probability  is  not  known,  so  we  cannot  pursue  the  solution  n(s,  t)  to  the  partial 
differential  equation  (1.3)  in  the  usual  way.  (Nor,  unfortunately,  does  there  seem  to 
be  an  obvious  way  of  working  out  the  probability  p0(t).  If  we  knew  n(s,  t),  we 
could  set  s  equal  to  zero  and  immediately  work  out  n(0,t),  which  equals  p0(t);  but 
that  we  do  not  know  n(s,  t )  is  the  crux  of  the  problem.) 


In  fact,  it  is  perfectly  possible  to  find  the  probability  distribution  of  X(t),  the  queue 
size  at  time  t;  but  the  methods  used  are  different  to  any  in  the  course  so  far,  and 
their  derivation  is  neither  simple  nor  quick.  We  shall  not  deal  with  these  methods 
here.  It  turns  out  that  the  queue  size  probability  distribution  is  most  easily 
expressed  in  terms  of  the  probability  P(X(t)  >  x): 


P(X(t )  >  x)  =  x  X- 


rt 


u  =  0 


2\k 


—  {2  +  c)w  yX  —  1 


y  (leu  ) 
k  =  0  k-  (*  +  k)\ 


du, 


assuming  that  at  time  zero  there  was  nobody  queueing  (i.e.  that  X(0)  =  x0  =  0), 
and  where  obviously  P(X(t)  >  0)  =  1. 


You  do  not  need  to  learn  this!  We 
shall  not  be  using  it. 


* 


The  simple  model  leads  to  some  rather  complicated  results!  Numerical  methods 
can  be  applied  to  find  approximations  to  these  probabilities;  alternatively,  they  can 
be  estimated  using  simulation.  We  shall  not  even  bother  to  write  down  the 
probability  generating  function  n(s,  t),  the  particular  solution  of  the  partial 
differential  equation  (1.3)  corresponding  to  the  case  X(0)  =  0. 
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The  exact  probability  distribution  for  the  queue  size  at  time  t  in  the  M/M/1  queue 
has  turned  out  to  be  somewhat  less  tractable  than  those  distributions  derived  for 
other  variations  on  the  birth  and  death  process.  The  simplicity  of  the  model  lies  in 
its  description  rather  than  anything  else!  All  we  did  was  to  look  at  the  queue  size: 
just  one  aspect  of  congestion. 

Other  random  features  of  the  model  we  might  reasonably  have  looked  at  include: 
the  total  time  a  new  arrival  at  time  t  might  expect  to  have  to  queue;  the  time  for 
which  a  server  is  busy  between  consecutive  intervals  of  idleness,  and  the  number  of 
customers  served  during  such  bouts  of  service,  or  busy  periods  as  they  are  called. 
The  first  of  these  depends  on  the  distribution  of  the  queue  size,  X(t),  anyway;  and 
the  busy  period  calculations  are  no  easier  than  those  for  the  queue  size. 

What  prove  to  be  much  easier  to  analyse,  mathematically,  are  the  properties  of  the 
simple  queue  a  long  time  into  the  future.  We  shall  consider  these  in  the  section 
which  follows. 


2  The  simple  queue  —  steady  state 


In  this  section  we  consider  the  question  of  what  might  be  the  appearance  of  the 
queue  after  it  has  been  operating  for  a  long  time.  In  Unit  8  we  answered  a  similar 
question  about  the  much  simpler  two-state  (on-off)  process,  and  then  about  the 
immigration-death  process  (actually  a  rather  closer  analogy  to  the  simple  queue). 
In  principle  nothing  is  different  in  this  case,  except  for  the  sort  of  problem  one 
might  address.  Is  the  server  overwhelmed,  or  not?  If  not  —  that  is,  if  the  queue  has 
settled  down  —  what  does  the  queue  look  like?  These  questions  are  about  the 
equilibrium  (or  steady-state)  process,  and  in  order  to  gain  rather  more 
understanding  than  we  have  at  the  moment  about  the  simple  queue,  we  shall  now 
look  at  this  aspect  of  it. 


2.1  Queue  size 

There  are  two  ways  of  deriving  the  steady-state  or  equilibrium  distribution  of  the 
queue  size,  assuming  it  exists.  Both  methods  involve  a  return  to  first  principles,  to 
the  differential-difference  equations  (1.2a)  and  (1.2b).  First,  we  could  set  the 
derivatives  dpx(t)/dt  equal  to  0  for  x  =  0,  1,  2, ...  —  this  represents  the  notion  that 
the  probabilities  px  =  lim  px(t)  are  invariant  with  respect  to  time,  which  is  what  we 

mean  by  the  phrase  steady-state.  Then  we  obtain 

0  =  XpJC-i  +  epx+l-(X  +  e)pxt  x  =  1,2,...,  (2.1a) 

0  =  £p1-/po.  (2.1b) 

From  the  second  of  these  equations  it  follows  that  Pi_  =  pp0,  where  p  =  A/e. 

Question  2.1  Using  Equation  (2.1a),  find  the  probabilities  p2  and  p3  in  terms  of 
Po •  Hence,  guess  an  expression  for  the  probability  px  in  terms  of  p0,  p  and  x,  and 
verify  it  by  substitution.  □ 

You  will  have  found  that  the  equilibrium  distribution  of  queue  size  (if  it  exists) 
takes  the  form 


Px  =  PxPo>  x  =  0,1,2,..., 


where  p  =  2/e.  The  quantity  p  is  the  ratio  of  arrival  rate  to  service  rate,  and  it  is 
known  as  the  traffic  intensity  of  the  process.  If  A  >  e,  then  the  arrival  rate  exceeds 
the  service  rate,  and  the  queue  will  end  up  getting  longer  and  longer:  it  ‘explodes’. 
Customers  are  arriving,  on  average,  faster  than  the  server  can  cope  with  them. 
Alternatively,  we  can  write  this  as  p  >1.  If,  on  the  other  hand,  the  service  rate  s 
exceeds  the  arrival  rate  A,  then  p  <  1,  and  the  server  can  cope. 


By  definition  p  >  0. 
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Now,  for  the  equilibrium  distribution  to  exist,  it  is  necessary  that  the  probabilities 
Po ,  Pi,  Pi,  in  Formula  (2.2)  should  sum  to  one. 

Question  2.2  Determine  the  condition  for  the  equilibrium  distribution  to  exist 
and,  assuming  the  condition  to  hold,  evaluate  p0  in  terms  of  the  traffic  intensity  p, 
and  px  in  terms  of  p  and  x.  In  the  long  term,  what  proportion  of  time  is  the  server 
idle?  What  is  the  average  queue  length?  □ 

So  it  turns  out  that  the  queue  settles  down  to  stochastic  equilibrium  if  0  <  p  <  1 : 
customers  are  not  arriving  too  rapidly,  and  the  server  can  cope.  In  this  case  the 
equilibrium  distribution  is  given  by 

Px  =  (1  -  p)px- 

In  other  words,  the  equilibrium  distribution  is  G0(p),  with  probability  generating 
function 


n(s)  =  j — p~,  o<p  <  l, 

1  —  ps 


having  mean  p/(l  —  p),  which  is  very  large  if  p  is  close  to  1. 


(2.3) 


Question  2.3  Assume  that  the  arrival  and  departure  of  customers  at  a  village  post 
office  may  be  modelled  as  a  simple  queue,  and  that  on  average  a  customer  arrives 
every  12  minutes. 

(i)  State  a  condition  on  the  average  service  time  for  the  queue  to  attain 
stochastic  equilibrium.  What  would  happen  if  this  condition  were  not 
satisfied? 

(ii)  If  the  average  service  time  is  8  minutes,  what  proportion  of  the  time  is  the 
counter  clerk  idle? 

(iii)  What  is  the  average  queue  length  when  the  average  service  time  is  8  minutes? 

(iv)  You  enter  the  post  office  some  time  after  it  has  opened.  What  is  the 
probability  that  there  will  be  more  than  two  people  already  queueing  ahead 
of  you?  □ 


It  was  mentioned  that  there  are  two  ways  of  deriving  this  steady-state  probability 
distribution.  The  second  is  to  go  straight  to  the  partial  differential  equation  (1.3) 
for  the  probability  generating  function  U(s,t).  The  probabilities  {px},  where 
px  =  Jim  px(t)t  are  invariant  with  time;  so,  like  them,  their  probability  generating 

function  should  be  invariant  with  time.  In  fact,  it  is 

II(s)  =  lim  II(s,  t ). 

t~*  00 

Setting  dll/dt  equal  to  zero  in  Equation  (1.3)  and  cancelling  (1  -  s),  we  obtain 

H)nv°=o, 

from  which 


This  defines  a  probability  distribution  if  and  only  if  11(1)  =  1,  so  p0  =  1  -  p.  Thus 
we  are  led  to  the  same  conclusions  as  from  a  direct  analysis  of  the  probabilities, 
but  rather  more  easily. 


It  is  important  to  recognize  that  the  queue  settles  down  to  equilibrium  only  as 
long  as  p  is  strictly  less  than  one.  Obviously,  if  p  is  greater  than  one,  then 
customers  are  arriving  faster  than  the  server  can  cope  with  them,  and  it  is  not  at 
all  surprising  that  the  queue  eventually  explodes.  What  is  not  so  obvious 
intuitively,  is  that  the  queue  will  become  arbitrarily  large  even  when  p  is  equal  to 
one,  that  is,  when  customers  are  arriving  on  average  at  exactly  the  average  rate 
that  the  server  can  process  them. 


The  case  p  =  0  corresponds  to  a 
simple  queue  where  the  arrival  rate 
is  zero:  it  is  not  very  interesting,  but 
is  included  for  completeness. 
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Question  2.4  Suggest  an  explanation  for  why  the  simple  queue  with  equal  arrival 
and  service  rates  should  fail  to  settle  down  to  an  equilibrium  random  process.  □ 

2.2  Queueing  time 

If  we  now  assume  that  we  are  dealing  only  with  a  simple  steady-state  queue,  then 
we  can  answer  other  questions  about  general  congestion  which  were  mentioned 
towards  the  end  of  Section  1.  How  long  does  an  arriving  customer  have  to  spend 
in  the  queue,  just  waiting?  How  long  before  he  can  leave?  If  we  assume  that  we  are 
concerned  with  an  arrival  after  the  queue  has  been  operating  for  ‘a  long  time’,  then 
we  can  forget  the  unattractive  exact  distribution  theory  of  Section  1,  and  use  the 
geometric  distribution  just  derived.  Remember  that 

queueing  time  =  waiting  time  +  service  time, 

where  the  waiting  time  is  the  time  spent  literally  waiting  in  the  queue  while  earlier 
arrivals  receive  attention.  Once  the  customer  reaches  the  front  of  the  queue,  then 
his  waiting  time  ends  and  his  service  time  begins  immediately.  Of  these  two 
components,  it  is  the  first  which  depends  on  the  size  of  the  queue  at  arrival  —  the 
number  of  customers  in  front. 

If  there  are  no  customers  in  front,  then  the  arriving  customer’s  waiting  time  is 
zero.  Otherwise,  suppose  that  the  number  of  customers  ahead  is  exactly  x:  the 
probability  of  this  is 

P(X  =  x)  =  px  =  (1  -  p)px. 

His  waiting  time  will  consist  of  the  residual  service  time  of  the  first  customer  (he 
might  have  arrived  just  after  that  service  commenced,  or  perhaps  very  close  to  the 
end),  plus  the  complete  service  times  of  the  remaining  (x  -  1)  customers.  The 
algebra  of  residual  time  is  usually  rather  complicated:  however,  recall  that  for  the 
simple  queueing  model  the  service  time  is  exponential  —  this  distribution  has  the 
property  of  memorylessness,  and  so  the  distribution  of  the  residual  service  time  for 
the  first  customer  is  the  same  as  the  service  time  for  subsequent  customers. 

Overall,  the  waiting  time  for  an  individual  joining  the  queue  when  there  are  x 
individuals  ahead  of  him  is  simply  the  sum  of  x  independent  exponential  variates, 
each  with  parameter  e.  This  includes  the  case  when  x  is  zero.  To  find  the 
distribution  of  a  customer’s  queueing  time,  to  this  waiting  time  must  be  added  the 
service  time  of  the  customer  himself,  which  is  independent  of  any  preceding  service 
time  and  also  has  the  distribution  M(e).  The  sum  of  (x  +  1)  independent 
exponential  variates  M(e)  has  the  gamma  distribution  T(x  +  l,e)  with  probability 
density  function 

fXp  -  ttpx  +  1 

f[t\X  =  x)  =  — - — p - ,  t  >  0. 

x! 

Using  the  Theorem  of  Total  Probability  and  averaging  over  X  (which,  remember, 
is  geometric),  we  find  that  the  total  time  spent  in  the  queue,  both  waiting  and 

being  served,  for  a  ‘typical’  arrival  in  a  steady-state  queue,  has  probability  density 
function 

f(t)=  tf(t\X  =  x)P(X  =  x) 

x  =  0 

00  tXo~ZtQX  +  1 

=  E  -  p)o* 

x  =  0  x- 

oo 

=  ee~Et(\  -  p)  £  ( £pt)x/x\ 

x  =  0 

=  £e~a(\  —  p)eept 

=  (e-  X)e~(E~X)t.  (2.4) 

That  is,  the  total  queueing  time  for  a  typical  arrival  is  exponential,  M{s  -  X). 
Remember  that  we  have  restricted  attention  to  the  case  where  pel,  that  is,  where 
the  service  rate  e  exceeds  the  arrival  rate  X. 


The  Theorem  of  Total  Probability 
has  been  used  here  to  find  a 
probability  density  function  /(f) 
using  a  sequence  of  conditional 
density  functions  f{t\X  =  x).  This  is 
the  same  as  calculating  the 
probability  P{t  <  T  <  t  +  St)  using 
the  conditional  probabilities 
P(t  <  T<  t  +  St\X  =  x). 


10 


2.3  The  busy  period 


Another  feature  of  congestion  is  the  busy  period,  which  is  the  time  spent  by  the 
server  continuously  attending  to  customers  between  consecutive  periods  of  rest. 
Obviously  a  related  random  variable  is  the  number  of  customers  served  during 
such  a  period.  These  are  not  random  variables  whose  analysis  necessarily  assumes 
that  the  queue  has  attained  steady  state,  or  even  that  the  condition  p  <  1  holds. 
The  mathematics  is  very  detailed,  and  we  shall  not  bother  with  it. 

Some  useful  results  are,  however,  not  too  difficult  to  deduce.  If  p  >  1,  then  the 
queue  will  eventually  explode:  early  on,  occasional  periods  of  idleness  are  possible, 
but  not  guaranteed  —  and  eventually  a  busy  period  will  be  initiated  which  never 
ends.  (If  p  =  1,  the  situation  is  rather  complicated.  It  is  true  that  any  busy  period 
eventually  comes  to  an  end  with  probability  one,  but  the  expected  duration  of  any 
busy  period  is  infinite,  as  is  the  expected  number  of  customers  served  during  it. 

You  need  not  worry  about  the  details  of  how  these  results  are  derived.) 


If  p  <  1,  then  intervals  of  idleness,  alternating  with  busy  periods  where  the  server 
is  serving  continuously,  are  guaranteed.  In  this  case,  a  consideration  of  long-term 
averages  (if  not  exact  probabilities)  is  straightforward.  Over  a  very  long  period  of 
time,  of  duration  Q  say,  the  server  will  be  idle  for  a  total  time  of  (1  —  p)Cl.  Since  an 
arrival  terminates  a  period  of  idleness  and  inter-arrival  times  have  the  M(A) 
distribution,  which  is  memoryless,  the  duration  of  each  period  of  idleness  is  an 
observation  from  M(/ 1),  and  so  has  average  length  1/A,  from  which  it  follows  intuitively 
that  the  number  of  idle  intervals  over  the  period  of  duration  Q  has  expectation 


(1  ~  p)Q 

1/A 


=  A(1  -  p)Q. 


Since  busy  periods  alternate  with  intervals  of  idleness,  the  expected  number  of 
busy  periods  is  also  A(1  —  p)Q,  covering  a  total  time  of  pd,  so  the  mean  duration 
of  a  busy  period  is 


pQ 

A(1  -  p)Q 


l/(e  -  A), 


which  is  the  same  time  as  a  customer  would  expect  to  have  to  spend  in  the  queue. 


Question  2.5  What  is  the  expected  number  of  customers  served  during  a  busy 
period?  □ 


By  restricting  the  analysis  in  this  section  to  the  long-term  properties  of  the  simple 
queue,  we  have  been  able  to  derive  an  intuitively  reasonable  condition  for  stability, 
and  some  useful  results  about  the  nature  of  the  resulting  congestion  when  that 
condition  holds.  In  practice,  queues  do  not  go  on  forever  (though  it  might 
sometimes  feel  rather  like  it):  if  nothing  else,  even  the  opportunity  to  queue  starts 
in  many  cases  only  at  opening  time  and  ceases  at  closing  time.  (Mathematically 
speaking,  the  arrival  rate  ‘out  of  hours’  is  constrained  to  be  zero.)  Experience 
suggests  that  for  most  queues  (apart  from  the  occasional  unpredictable  accident  of 
fate)  the  traffic  intensity  is  less  than  one,  and  the  question  arises  of  just  how  ‘long’ 
the  long  term  is.  Evidently,  if  the  queueing  process  has  been  going  for  only  a  short 
time,  then  the  influence  on  present  queue  size  of  the  queue  size  at  time  zero  will  be 
considerable.  Later  on,  it  will  matter  less. 

It  would  be  quite  possible  (though  not  entirely  straightforward,  even  using  a 
computer)  to  compare  exact  probabilities  with  the  limiting  steady-state 
probabilities,  and  then  to  decide  when  the  latter  got  close  enough.  But  in  practice, 
it  is  not  a  matter  of  deciding  when  two  models  become  sufficiently  alike  —  it  is  a 
choice  between  a  model  which  is  almost  unusable,  and  another  which  is  rather 
straightforward:  hardly  a  choice  at  all. 


3  Queues  with  more  than  one  server 


So  far  the  sort  of  queue  we  have  looked  at  has  been  restricted  to  one  where  only 
one  server  is  in  attendance.  Actually,  this  is  rather  unusual:  even  at  quite  small 
commercial  establishments,  like  a  newsagent  or  a  shoeshop,  one  would  often  find 
two  or  three  assistants  behind  the  counter.  If  we  are  to  model  this  sort  of  situation, 
then  we  must  develop  a  more  elaborate  model  than  that  described  so  far. 


3.1  The  M/M/n  queue 

Imagine,  for  instance,  a  situation  where  there  are  three  servers.  If  there  are  fewer 
than  three  customers  requiring  service  (we  would  say  ‘in  the  queue’,  though  it 
sounds  rather  odd  at  first),  then  they  are  all  being  seen  to  and  at  least  one  server  is 
idle.  When  there  are  exactly  three  customers  in  the  queue,  then  all  the  servers  are 
busy,  but  there  is  nobody  being  kept  waiting.  Any  customers  arriving  to  find  the 
servers  busy  join  a  central  queue,  moving  forward  as  served  customers  depart. 
Their  service  commences  (though  does  not  necessarily  end)  in  the  order  of  arrival. 
A  customer  has  no  choice  over  which  server  he  gets:  when  it  is  his  turn,  he  moves 
forward  to  whichever  server  has  just  been  freed. 

A  rather  elaborate  multi-server  queueing  model  would  allow  for  different  mean 
service  times  filt  A*3>  •••,  so  that  different  servers  could  be  distinguished  as 
being  slower  or  faster  on  average  than  others.  However,  in  our  model,  we  shall 
assume  that  the  service  time  distribution  is  the  same  for  all  servers. 

More  generally,  suppose  that  customers  arrive  at  random  and  independently  of 
one  another  at  a  multi-server  queue  where  the  queue  discipline  is  first-come-first- 
served.  (For  the  single-server  queue  this  is  the  same  as  saying  first-in-first-out,  but 
for  the  multi-server  queue  the  exit  order  might  be  quite  different.)  These  arrivals 
are  modelled  as  a  Poisson  process,  with  arrival  rate  x;  further,  we  assume  that  the 
service  times  are  independent  exponential  random  variables,  identically  distributed 
from  server  to  server  and  having  mean  1/e.  Thus,  if  there  are  n  servers  altogether, 
then  this  type  of  queue  has  the  specification  M/M/n. 

For  the  M/M/1  queue,  you  saw  that  a  server  would  be  overwhelmed  unless  the 
service  rate  were  strictly  faster  than  the  arrival  rate.  Here,  customers  are  arriving 
just  as  fast  as  they  were  before,  and  all  servers  are  serving  at  the  same  average  rate 
as  each  other.  However,  because  there  are  more  of  them,  we  would  not  expect  the 
queue  to  explode  simply  because  customers  were  arriving  too  fast  for  just  one  of 
the  servers  to  cope.  It  is  quite  obvious  that  the  ‘criticality’  conditions  for  the 
M/M/n  queue  should  reflect  the  potential  throughput,  which  is  now  a  multiple  of 
what  it  was  before.  We  should  find  this  reflected  also  in  the  mean  queue  length 
and  the  mean  queueing  time,  which  have  both  been  used  as  measures  of 
congestion. 

We  shall  start  an  analysis  of  this  queue  by  determining  the  differential-difference 
equations  for  the  queue  size  distribution.  (However,  our  experience  with  the 
M/M/1  queue  suggests  that  it  will  be  more  informative  to  proceed  directly  to  the 
equilibrium  process  after  that.  This  is  what  we  shall  do.) 

The  main  difference  to  note  between  the  M/M/1  and  M/M/n  queues  is  that  during 
periods  in  which  the  number  of  customers  (x)  in  the  M/M/n  queue  is  less  than  the 
number  of  servers,  there  are  no  delays,  and  customers  will  be  exiting  as  fast  as  the 
servers  can  process  them,  that  is,  at  an  overall  rate  proportional  to  the  number  of 
customers  (xa).  In  other  words,  the  exit  process  is  (mathematically)  the  same  as  a 
death  process:  as  long  as  the  queue  does  not  get  too  long  (x  <  n),  the  whole 
queueing  process  looks  exactly  like  the  immigration-death  process  of  Unit  8, 
Subsection  5.1.  Thus,  the  differential-difference  equations  may  be  written  (setting 
Px  =  K  v*  =  xe)  as 

jtPo(t)  =  ePi(t)“  ^  Po(4 

d 

-px(t)  =  lpx.x{t)  +  (x  +T)epJC+1(f)  —  (A  +  xs)px(t),  x  =  1,  2,...,  n  -  1. 


\ 


Page  8 


px(t)  =  P(X(t)  =  x) 
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Question  3.1  Write  down  the  differential-difference  equations  for  the  probability 
distribution  of  X{t)  for  x  =  n,  n  +  1, . . .  .  □ 


The  complete  family  of  differential-difference  equations  for  the  M/M/n  queue 
constitutes  another  variation  on  the  general  theme  of  birth  and  death  and  takes 
the  form 


d 

dt 


Po(t)  =  epi(t)  -  Ap0{t), 


(3.1a) 


£  (t)  =  faPx-iit)  +  {x  +  l)epx+1(t)  —  (2  +  xe)px(t) 
dt  x  (2 Px-i(t)  +  nepx+l{t)  -  (2  +  ns)px(t) 


X  =  1,2 1 

x  =  n,n  +  1,. . .  . 


(3.1b) 

(3.1c) 


We  shall  not  attempt  to  solve  these  equations  to  find  the  probability  distribution 
WO}-  find  the  equilibrium  queue  size  probability  distribution  { px }  (if  it  exists), 
the  left-hand  side  in  this  family  of  equations  is  set  equal  to  zero.  Multiplying  by  sx 
and  summing  over  x  =  0,  1,  2,...  would  yield  an  equation  for  the  probability 
generating  function  n(s)  of  X  =  lim  X(f).  However,  the  break  in  the  pattern  which 

occurs  at  x  =  n  means  that  any  formulation  for  n(s)  is  going  to  be  rather 
complicated.  It  is  easier  in  this  case  to  calculate  the  probabilities  {px}  recursively, 
by  setting  the  left-hand  sides  of  Equations  (3.1)  equal  to  zero  and  rearranging  them: 

2 

Pi  =  ~Po, 

£ 


1 


Px+  1  =  i 


e(x  +  1) 


((2  +  xe)px-Xpx.t)  x  =  1,2, ...,w  —  1 


1 

—  ((2  +  ne)px  -  2px_1) 


x  =  n,n  +  1,...  . 


(3.2) 


Question  3.2 


Verify  (by  substitution)  that  the  family  of  equations  (3.2)  has  solution 


x  =  0,  1  ,...,n  —  1 
x  =  n,n  +  1, . . . , 


and  derive  the  condition  for  this  to  define  a  probability  distribution.  □ 


It  is  convenient  to  introduce  the  symbol  K,  defined  by 


1  -T  2/s  + 


mn~l 

{n  -  1)! 


then,  from  Solution  3.2,  £  pt  =  p0K,  and  the  sequence  of  equations  (3.3)  defines  a 

i  =  0 

probability  distribution  as  long  as  K  is  convergent:  that  is,  as  long  as  the  term 
£(2/ne)J  converges;  to  put  it  another  way,  the  queue  will  attain  steady  state  only 
as  long  as  2  <  ns.  If  we  define  the  traffic  intensity  p  to  be  equal  to  2/(ne)  (which 
gives  p  =  2/e  in  the  M/M/1  case,  as  before),  then  the  queue  will  attain  equilibrium 
as  long  as  p  <  1.  What  this  means  is  that  the  arrival  rate  2  must  be  less  than  the 
maximum  throughput  ne  attainable  for  the  queue,  that  which  would  be  achieved 
when  all  the  servers  are  working  together.  Then  the  probability  distribution  can  be 
written  in  terms  of  p  and  K  (=  1  /p0)  as 


V 


(3.4) 


Now  K  may  be  written  in  terms  of  p  as  follows: 


,  (»p)2  (np) 

K  =  1  +  np  +  +  . . .  +  v 


2! 


(n  -  1)! 


"-1  (nn)"  00 

+  {J^-Ipj 


.  ( np )2  ( np)n  1 

=  1  +np  +  +  ...  -t-  -  + 


n\  jt o 

(np)" 


2! 


(n-  1)!  n\  (1  -p)' 


(3.5) 


px  =  lim  pjjt) 

t~*  oc 


By  definition,  p  >  0. 
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Question  3.3 

(i)  For  a  two-server  queue,  show  that 


(ii) 

.  (iii) 


K  = 


1  +  p 


Po  = 


1  -  p 


Px  =  2(!  .  x  =  1,2,...  . 


1  ~p  ™  1  +  p*  "  1  +p 

Hence  find  the  probability  generating  function  of  X  in  terms  of  p. 
What  is  the  mean  queue  length?  □ 


We  are  now  in  a  position  to  solve  problems  in  the  style  of  the  next  example,  but 
as  you  can  see,  the  arithmetic  computation  required  is  extensive. 


Example  3.1 

At  a  supermarket,  customers  enter  at  an  average  rate  of  eight  per  minute. 
Individual  cashiers  take  an  average  of  three  minutes  to  serve  each  customer.  What 
is  the  minimum  number  of  servers  necessary  for  the  queue  to  be  stable?  If  there 

were  30  checkout  desks,  what  proportion  of  customers  would  receive  immediate 
service? 


Solution 


The  arrival  rate  is  X  —  8,  and  the  service  rate  for  each  cashier  is  e  =  1/3.  For  the 
traffic  intensity  to  be  less  than  one,  it  is  necessary  that  n  exceed  4/e  =  24,  so  25  is 
the  minimum  number  of  servers  which  will  result  in  a  stable  queue. 

If  there  are  30  servers,  then  a  customer  finding  less  than  30  other  customers  ahead 
of  him  will  receive  immediate  service.  The  probability  of  this  is 

P(X  ^  29)  =  Po  +  Pi  +  ■  •  •  +  P29- 

The  values  of  these  probabilities  are  obtained  from  Equations  (3.4)  and  (3.5)  with 
n  =  30  and  p  =  24/30.  Thus 


P(X  <  29)  = 


_ 1  +  24  +  242/2!  +  . . .  +  2429/29! _ 

1  +  24  +  242/2!  +  ...  +  2429/29!  +  243O/(30!  x  0.2) 


=  0.8271.  □ 


Unfortunately  there  are  no  easy  general  expressions  for  the  moments  of  the 
probability  distribution  (3.4),  although  some  of  the  results  are  not  too  difficult  to 
derive  as  long  as  the  number  of  servers  is  not  too  large. 


3.2  Queueing  time 


Suppose  that  you  arrive  at  the  n-server  queue  to  find  x  people  ahead  of  you.  Your 
waiting  time  is  zero  if  x  <  n  and  you  can  go  straight  to  one  of  the  free  servers. 
Otherwise,  if  x  >  «,  then  n  people  are  being  served  and  x  —  n  are  waiting  ahead  of 
you.  This  means  that  you  will  have  to  wait  before  you  can  be  served  until 
^  T  (x  n)  departures  have  taken  place:  and  since  the  servers  are  fully  stretched, 
these  departures  are  happening  according  to  a  Poisson  process  at  average  rate  m. 
In  principle,  the  distribution  of  the  waiting  time,  and  hence  of  the  queueing  time, 
can  be  deduced  from  these  brief  observations.  In  practice,  the  resulting  expressions 

are  not  very  convenient.  Denoting  waiting  time  by  the  random  variable  W,  we 
have  that 


P(W=0)  =  P(X  <n) 

n-  1 

=  E  pj 

J  =  0 


1  /  1  ,  (np)2  ( np)n  1 

—  ^  (  1  +  np  +  —  +  •  •  •  +  t - tt:  1,  by  Equations  (3.4), 


K 

=  1  - 


2! 


(n  -  1)! 


(npy 


,  by  Equation  (3.5), 


n\K(  1  -p) 

is  the  probability  that  an  arriving  customer  does  not  have  to  wait  at  all. 


(3.6) 
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Otherwise,  his  waiting  time  is  non-zero.  Writing  P(w  <  W<  w  4-  Sw)  ~  g(w)  <5vv, 
then  by  the  Theorem  of  Total  Probability,  we  have 

g(w)  =  £  g(w  I X  =  x)  P(X  =  x). 

x  =  n 


The  arriving  customer  has  to  wait  for  1  +  (x  —  n)  departures  to  take  place;  these 
departures  are  happening  according  to  a  Poisson  process  at  average  rate  ne.  The 
waiting  time  is  therefore  T(1  +  x  —  n,ne).  This  means  that 


g(w  |  X  =  x)  = 


wx-ne-nE  w 


{ne) 


1  +X-/1 


(x  —  n)\ 


(3.7) 


Here,  as  in  the  derivation  of 
Equation  (2.4),  we  write  things  in 
terms  of  conditional  density 
functions  rather  than  the  equivalent 
but  cumbersome 

P{w  <  W  <  w  +  dw) 

=  £P(w<  W<  w  +  <5w|Y  =  x) 
x  P(X  =  x). 


Question  3.4  Show  that  for  w  >  0,  the  waiting  time  has  the  probability  density 
defined  by 


ne{np)n  a-0)w 


(3.8) 


(You  will  find  the  substitution  j  =  x  —  n  helpful.)  □ 


Equations  (3.6)  and  (3.8)  express  the  distribution  of  the  waiting  time  IT  as  a 
mixture  of  discrete  and  continuous  components.  First,  W  can  be  zero  (discrete);  if 
not,  then  it  can  take  any  positive  value.  Because  of  this  mixture,  the  c.d.f.  is  the 
easiest  way  to  specify  the  distribution  of  W: 


Fw(w )  =  P(W<  w) 

=  p(w  =  0)  + 


f*w 


g(v)  dv. 


0 


where  P(W  =  0)  is  given  by  Equation  (3.6)  and  g  is  given  by  Equation  (3.8).  The 
p.d.f.  and  c.d.f.  of  W  are  shown  in  Figures  3.1  and  3.2. 


As  you  can  check,  a  straightforward  integration  shows  that 


P(W=  0)  + 
as  required. 


g(w)dw  =  1, 


Jo 


3.3  The  Ml  Ml  oo  queue 

If  the  number  of  servers  can  be  assumed  to  be  infinite  (or  virtually  infinite),  then 
we  have  what  is  sometimes  called  ‘a  queue  with  ample  servers’.  No  customer  ever 
has  to  wait,  as  there  is  always  somebody  available  to  give  immediate  attention. 

This  utopian  situation  could  not  be  realized  in  practice,  but  something  very  close 
to  it  could  happen.  The  M/M/ oo  queue  is  simply  the  immigration  -death  process  of 
Unit  8,  Subsection  5.1.  In  that  case,  the  exact  probability  distribution  for  the 
population  size  was  calculated:  assuming  the  population  to  be  of  size  zero  initially, 
then  X(t)  ~  Poisson(/i(l  —  e~Et)/e).  The  limiting  distribution  is  Poisson(2/e),  a  result 
which  could  be  obtained  by  letting  n  tend  to  infinity  in  Equation  (3.3). 
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3.4  General  service  times 


The  M/G/n  queue  where  several  servers  are  on  hand  but  where  the  service  time  is 
arbitrary  has  a  complex  structure,  and  we  shall  not  deal  with  it.  The  M/G/oo 
queue  where  customers  are  always  served  immediately  is  of  some  interest, 
particularly  once  it  has  attained  equilibrium.  If  the  random  arrival  times  are 
written  tu  t2,  t3, ...,  then  the  exit  times  can  be  written  tx  +  gt,  t2  +  g2,  h  +  g3, 
where  g(-  is  the  service  time  of  the  customer  who  arrived  at  time  tt.  The  customers 
will  not  necessarily  leave  in  the  order  in  which  they  arrived,  but  it  is  interesting 
that  after  some  time  the  departure  process  is  indistinguishable  from  a  Poisson 
process,  also  at  rate  X.  What  this  means  in  particular  is  that  if  these  departing 
customers  then  go  on  to  a  subsequent  service  point,  then  the  input  there  may  also 
be  regarded  as  random. 


More  generally,  there  are  many  applications  where  the  ‘point  process’  {tx  +  gu 
*2  +  Si>  h  +  ^3 9  -  -  -}  arises,  and  to  be  able  to  regard  this  as  ‘approximately’  a 
Poisson  process  almost  always  results  in  a  considerable  simplification  of  the 
analysis.  For  instance,  consider  the  following  situation.  Cars  pass  an  observer 
standing  by  the  side  of  a  road  according  to  a  Poisson  process  in  time.  They  are 
travelling  at  constant,  but  different,  speeds,  and  when  they  pass  a  second  observer 
a  mile  further  up  the  road,  their  order  might  have  changed.  A  car  passing  the  first 
observer  at  time  tt  will  pass  the  second  at  time  tt  +  gh  where  gf  is  the  time  it  takes 
it  to  travel  one  mile.  What  the  second  observer  sees  is  also  random  traffic  flow. 


4  General  service  times 


Actually,  if  starting  at  time  0  the 
cars  pass  the  first  observer  according 
to  a  Poisson  process  in  time  at  rate 
X,  then  they  pass  the  second 
according  to  a  non-homogeneous 
Poisson  process  with  rate 
X{t)  =  X  G(t),  where  G  is  the  c.d.f.  of 
the  time  random  variable.  After 
some  time,  G(t)  =  1,  and  the  result 
follows. 


The  single  modification  to  the  simple  single-server  queueing  model  that  would 
immediately  render  it  more  representative  of  real  life  is  to  allow  the  service  time  to 
be  not  necessarily  exponential,  but  general,  with  distribution  function  G(r),  t  >  0. 
Customers  would  still  arrive  singly  and  at  random,  at  rate  X,  and  if  there  is  still  a 
single  server  then  the  queueing  model  for  this  situation  may  be  denoted  M/G/l.  If 
general  results  about  the  queue  can  be  derived  for  the  general  service  time 
distribution  function  G,  then  particular  cases  could  be  examined  simply  by 
substituting  particular  expressions  for  G  corresponding  to  cases  of  special  interest. 
Some  which  spring  to  mind  include  the  cases  of  uniform  service  time  (M/G/l)  and 
constant  service  time  (M/D/ 1),  and  perhaps  it  would  be  useful  in  some  applications 
to  be  able  to  use  a  model  which  gives  a  service  time  distribution  less  skewed  than 
in  the  exponential  case  —  the  gamma  distribution  is  one  such  (M/T/l). 

It  is  perfectly  possible  to  derive  results  for  the  queue  size  distribution,  waiting 
times  and  so  on  for  the  M/G/l  queue.  Although  it  is  convenient  to  be  able  to  write 
down  such  results,  in  practice  they  are  not  particularly  easy  to  use.  The  reason  for 
the  difficulty  is  that  when  a  general  service  time  distribution  is  adopted,  the 
Markov  properties  of  the  simple  queue  vanish.  For,  at  any  time  t,  the  future 
behaviour  of  the  queue  depends  on  the  time  for  which  the  customer  at  the  service 
point  at  time  t  has  been  receiving  service,  because  on  this  elapsed  service  time 
depends  the  residual  service  time  until  that  customer  departs.  The  memoryless 
property  of  the  exponential  service  time  distribution  has  been  lost.  A  severe 
consequence  is  that  we  now  cannot  write  down  the  differential-difference  equations 
for  the  queueing  process,  which  normally  follow  from  the  conditional  distribution 
of  X(t  +  St)  given  X(t).  The  methods  used  in  the  analysis  of  the  M/M/1  queue 
cannot  be  applied  in  this  case. 

The  approach  that  we  shall  take  towards  the  M/G/l  queue  in  this  unit  is  to  look 
at  the  special  case  of  constant  service  time  (the  M/D/ 1  queue),  and  obtain  the 
equilibrium  distribution  for  the  size  of  the  queue  and  the  time  it  takes  for  a 
customer  to  go  through  the  system.  This  will  include  a  statement  of  the  condition 
for  these  equilibrium  distributions  to  exist;  this  condition  we  shall  also  assume  in  a 
brief  discussion  of  the  general  M/G/l  queue. 
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4.1  The  M/D/l  queue 


For  the  M/D/l  queue  we  have  the  following  assumptions: 

— customers  arrive  for  service  according  to  a  Poisson  process  at  rate  k; 

— there  is  just  one  server  available; 

— it  takes  exactly  the  same  time  to  serve  each  customer:  this  time  we  shall 
denote  by  1/e  (so  the  service  rate  is  the  same  as  in  the  M/M/1  case  in  which 
the  service  time  has  the  M(e)  distribution). 

Cases  of  constant  service  time  (or,  more  precisely,  cases  where  it  is  reasonable  to 
assume  constant  service  time  as  a  sensible  model)  are  not  difficult  to  find.  One 
example  is  the  case  of  an  automated  cash  dispenser.  Basically,  every  customer  has 
to  do  the  same  thing:  key  in  a  PIN  (personal  identification  number),  key  in  the 
amount  of  cash  required,  wait  a  little  while,  and  then  collect  the  cash.  (There  are 
minor  variations,  like  deciding  whether  or  not  to  ask  for  a  receipt;  and,  of  course, 
different  customers  will  ask  for  different  amounts  of  cash.  The  service  time  is  not 
constant,  but  it  is  not  unreasonable  to  model  it  as  such.)  Other  examples  are  ticket 
queues  and  a  mechanical  car-wash. 

By  setting  the  service  time  equal  to  1  /e,  we  can  write  the  traffic  intensity  as  p  -  k/e 
as  in  Section  2:  it  is,  as  it  was  for  the  M/M/1  queue,  the  expected  number  of  new 
customers  to  arrive  while  just  one  is  being  dealt  with.  However,  in  the  case  of  the 
M/D/l  queue  we  can  say  more  than  this:  the  service  times  are  of  fixed  duration,  so 
the  number  A  of  new  arrivals  during  any  particular  service  interval  has  a  Poisson 
distribution  with  mean  p.  We  shall  use  this  fact  to  derive  the  equilibrium  queue 
size  distribution. 

Queue  size 

We  start  in  the  usual  way  by  writing  as  px(t)  the  probability  that  the  queue  is  of 
size  x  at  time  t.  We  know  precisely  the  way  the  queue  size  will  alter  over  the 
duration  of  a  single  ser'ice  interval  —  that  is,  over  the  time  interval  [£,  t  +  1/e]. 
The  number  of  arrivals  ha.  a  Poisson  distribution,  and  the  number  of  departures 
is  either  one  or  zero,  depending  on  whether  or  not  there  was  a  customer  being 
served  at  time  £. 

Question  4.1 

(i)  Suppose  the  queue  is  empty  at  time  £.  What  can  you  say  about  the  number  in 
the  queue  at  time  £  +  1/e? 

(ii)  Suppose  the  queue  is  not  empty  at  time  £  —  it  contains  n  customers  (n  >  1), 

say,  one  of  whom  is  being  served.  What  can  you  say  about  the  number  in  the 
queue  at  time  t  +  1/e?  □ 

It  has  been  usual  in  previous  analyses  to  examine  the  queue  size  at  time  f  +  St 
conditional  on  its  size  at  time  t  and  to  derive  a  set  of  differential-difference 
equations  for  the  state  probabilities.  In  this  case  we  shall  attempt  to  derive  a 
sequence  of  difference  equations  relating  the  queue  size  at  time  t  +  1/e  to  what  it 
was  at  time  t.  We  can  start  by  finding  the  probability  that  the  queue  is  empty  at 
time  t  +  1/e: 

p0(t  +  1/e)  =  P( there  is  nobody  in  the  queue  at  time  £  +  1/e). 

For  this  to  happen,  anybody  in  the  queue  at  time  £  must  have  departed  —  so 
either  the  queue  was  empty  at  time  £,  or  there  was  exactly  one  customer,  being 
served  at  the  time,  who  will  therefore  have  gone  by  time  £  +  1/e  —  and  there  must 
have  been  no  arrivals  (A  =  0)  during  the  time  interval  [£,  £  +  1/e].  The  probability 
of  no  arrivals  is  P(A  =  0)  =  e~p  =  e~x/e.  This  leads  to  the  result 

p0(t  +  1/e)  =  (po(£)  +  Pi{t))e~p. 


A  ~  Poisson(p) 

We  can  discount  the  complicating 
possibility  of  how  to  count  the 
customers  if  there  is  an  arrival  or  a 
departure  precisely  at  time  t,  or  at 
time  t  +  l/e.  These  events  are 
virtually  impossible. 
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What  about  the  probability  that  the  queue  contains  exactly  one  customer  at  time 
t  +  1/e?  If  it  was  empty  at  time  t,  or  if  there  was  one  person  in  it  at  time  t,  then  a 
single  arrival  is  needed  during  the  time  interval  (t,  t  +  1  /e)  who  will  be  the 
customer  counted  at  time  t  +  1/e.  The  probability  of  a  single  arrival  (in  any  service 
interval)  is  pe~p.  If  there  were  two  customers  present  at  time  t,  then  one  will  have 
gone  by  time  t  +  1/e,  leaving  one.  This  is  all  right,  as  long  as  there  are  no  further 
arrivals  in  the  interval  (the  probability  of  which  is  e~p ).  If  there  are  more  than  two 
customers  present  at  time  t,  then  there  will  be  at  least  two  there  at  time  t  +  1/e  — 
too  many.  We  are  led  to  the  result 

Pi(t  +  1/e)  =  (Po(t)  +  Pi(t))pe~p  +  p2(t)e~p. 

Question  4.2  Find  a  general  expression  for  the  probability  px(t  +  1/e)  that  the 
queue  is  of  size  x  at  time  t  +  1/e,  in  terms  of  its  size  at  time  t.  □ 

The  general  result  is 

px(t  +  1/e)  =  e~p({pQ(t)  +  Pi(t))^px  +  +  •••  +  +  P*+ i(0 

If  we  were  to  solve  the  family  of  equations  for  px(t  +  1/e)  to  obtain  the  sequence  of 
probabilities  {px(t)}  for  x  =  0,  1,  2,...  (together  with  some  initial  condition,  say 
po(0)  =  1),  then  we  would  have  obtained  the  exact  probability  distribution  of  X(t ) 
for  all  finite  t.  However,  all  we  shall  attempt  to  find  here  is  the  equilibrium 
distribution  —  the  probability  distribution  of  the  queue  size  ‘after  a  long  time’  — 
and,  in  the  process  of  finding  it,  the  condition  for  it  to  exist.  Writing  lim  px(t)  as 
px,  exactly  as  in  the  case  of  the  M/M/1  queue,  we  have 

Po  =  e~p(Po  +  Pi), 

Pi  =  e~p(iPo  +  Pi)P  +  Pi), 

Pi  =  e~p((Po  +  PiYiP2  +  PiP  +  Pi),  (4.1) 

P *  =  ‘-{(Po  +  + ...  +  pxp  +  p,+1) 


Question  4.3 

(i)  Multiply  each  of  Equations  (4.1)  in  turn  by  s°,  s1,  s2,...,sx,...  and  sum  over 
all  x  >  0,  to  show  that  the  probability  generating  function  n(s)  of  the 
equilibrium  distribution  (if  it  exists)  satisfies  the  equation 

n(s)  =  e~p{1  ~s)  (p0  +  pi  +  p2s  +  p3s2  +  ...). 

(ii)  Simplify  the  right-hand  side  in  part  (i)  to  show  that 

n(s)  =  -‘/p0  +  i(n(s)-p0)Y 

(iii)  Hence  show  that  the  probability  generating  function  n(s)  for  the  equilibrium 
queue  size  distribution  satisfies  the  equation 


(1  ~  s)Po 
1  -  sep(1~s)' 


□ 


(4.2) 


We  have  now  almost  obtained  the  probability  generating  function  of  queue  size, 
but  there  is  still  an  unknown  expression  on  the  right-hand  side,  the  probability  p0. 
Setting  s  equal  to  0  in  Equation  (4.2)  just  gives  n(0)  =  p0,  which  is  a  true 
statement  but  not  a  useful  one.  However,  if  we  expand  the  denominator  as  a 
power  series,  then  we  obtain 


n  (s)  = 


_ 0  -  S)p0 _ 

1  -  s(l  +  p(  1  -  s)  +  ^(p(  1  -  s))2  +  ...^ 

_ 0  ~  s)p0 _ 

1  -  s-sp(l  -s)-|j(p(l  -s))2  -  ... 
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Cancelling  (1  —  s)  in  the  numerator  and  denominator  on  the  right-hand  side,  and 
then  setting  s  equal  to  1 ,  we  have 


iKU-r**-. 

1  -  p 

and  for  this  to  equal  1,  so  that  n(.s)  is  a  probability  generating  function,  we  require 
p0  =  1  —  p.  We  have  simultaneously  completed  our  derivation  of  the  equilibrium 
p.g.f.  for  the  queue  size  in  an  M/D/ 1  queue,  and  established  the  condition  for  it  to 
exist.  For  p0  to  be  a  non-zero  probability,  it  is  necessary  that  0  <  p  <  1;  that  is,  we 
require  the  traffic  intensity  to  be  less  than  one.  The  final  result  is 


(1  ~  P)(  1  ~  s) 

1  -  sep(1-s)  ' 


(4.3) 


This  argument  is  the  same  as  that 
used  in  the  derivation  of  Result  (2.3) 
for  the  M/M/1  queue. 


It  is  possible  to  expand  the  right-hand  side  of  Result  (4.3)  as  a  power  series  in  s  to 
give  the  probabilities  {px},  but  it  is  a  tedious  exercise.  It  is  algebraically  easier  to 
return  to  the  family  of  equations  (4.1)  and,  starting  by  setting  p0  =  1  —  p,  to  obtain 
the  probabilities  px,  p2,  p3,  ...  by  recursive  solution  of  the  equations. 


Question  4.4  Find  px,  p2,  p3  (in  terms  of  p).  □ 

Question  4.5  Write  down  the  probabilities  p0,  px,  p2,  p3  for  the  M/M/1  queue 
and  for  the  M/D/ 1  queue  for  p  =  0.2,  0.5,  0.8.  Do  your  results  suggest  anything  to 
you?  (Do  not  spend  too  long  on  this  part  of  the  question.)  □ 

The  mean  queue  size  can  be  found  by  differentiating  the  probability  generating 
function  (4.3).  Try  the  following  question. 


Question  4.6  Rewriting  Result  (4.3)  in  the  form 
(1  -  sep(1  -s))  FI(s)  =  (1  -  p)(l  -  s), 

differentiate  both  sides  twice  with  respect  to  s,  and  then  set  s  equal  to  1  to  find  the 
mean  queue  size  px  =  IT(l).  What  happens  if  you  set  s  equal  to  1  after 
differentiating  only  once?  □ 


The  result 


p  -  y2 

1  -  p 


(4.4) 


may  be  compared  with  that  for  the  M/M/1  queue,  px  =  p/(  1  —  p),  and  with  the 
solution  to  Question  4.5.  The  arrival  rates  and  the  service  rates  for  the  two  queues 
are  identical,  but  for  the  M/D/1  queue  the  average  queue  length  is  shorter. 


Waiting  times 

The  distributions  of  waiting  times  and  total  queueing  times  are  complicated  by  the 
fact  that  unless  a  customer  arrives  to  find  the  queue  empty  (or  exactly  at  the 
instant  that  a  customer  leaves  —  which  is  virtually  impossible),  then  the  time  he 
spends  queueing  depends  on  the  distribution  of  the  residual  service  time  of  the 
customer  at  the  head  of  the  queue  at  the  time  of  his  arrival.  Usually,  for  general  G, 
this  is  rather  hard  to  find,  but  in  the  case  of  the  M/D/1  queue  we  can  argue  as 
follows.  A  customer  who  arrives  at  some  random  time  during  a  previous 
customer’s  service  time  is  no  more  likely  to  have  arrived  when  that  service  has  just 
begun  than  when  it  is  just  about  to  end  —  consequently,  the  residual  service  time 
may  be  modelled  as  a  uniform  distribution  on  the  interval  [0, 1/e].  The  waiting 
time  is  zero  for  a  customer  arriving  at  an  empty  queue  (probability  p0 );  but  if  the 
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queue  contains  x  previous  customers  (which  happens  with  probability  px ),  where 
x  >  1,  then  the  waiting  time  is  the  random  variable  V  +  (x  —  l)/e,  where 
F~  17(0, 1/e).  The  total  queueing  time  consists  of  this  waiting  time  plus  the 
customer’s  own  service  time,  a  further  1/e.  We  therefore  have  the  following  results 
for  the  total  queueing  time  conditional  on  the  number  of  customers  preceding  a 
new  arrival: 

(queueing  time  |  X  =  0)  =  service  time  = 

e 

(queueing  time  \X  —  x  >  0)<=  waiting  time  +  service  time 


s  e 


s 

=  V  +  x), 

8 

where  U  ~  (7(0, 1).  If  F~  U( 0, 1/e),  then 

U  =  eV~U{  0,1). 

Question  4.7  Use  the  result 

£(queueing  time)  =  £x[£(queueing  time  IX)] 
to  find  the  mean  queueing  time  for  the  M/D/1  equilibrium  queue.  □ 


4.2  The  A//G7 1  queue  —  steady  state 

For  the  single-server  queue  with  random  arrivals  but  general  service  time  T,  the 
derivation  of  results  is  a  much  more  complicated  exercise.  Most  of  the 
mathematics  is  difficult,  and  beyond  the  scope  of  this  course.  It  turns  out  that  all 
that  is  required  for  a  state  of  equilibrium  to  be  attained  is  that  ‘customers  should 
not  arrive  too  often’  (or,  equivalently,  that  ‘service  should  not  be  too  slow’):  in  fact, 
that  the  traffic  intensity 

p  =  X  x  expected  service  time  =  XE(T) 

should  be  less  than  one.  This  result  is  the  same  as  for  the  M/M/1  and  M/D/1 
queues. 

The  following  important  result  about  the  mean  queue  size  for  the  M/G/l  queue  is 
known  as  Pollaczek’s  Formula. 


Let  T  be  the  general  service  time  for  the  M/G/l  queue  with  arrival  rate  L  If 
the  equilibrium  queue  size  probability  distribution  exists  (that  is,  if 
p  =  A  E(T)  <  1),  then  the  mean  queue  size,  once  steady  state  has  been 
attained,  is 


P  -  iP2  +  P2  V(T) 

1  -  p 


(For  the  M/D/1  queue,  V(T)  is  zero.) 


The  result  is  interesting  because  it  demonstrates  that  in  equilibrium  the  average 
queue  length  depends  not  just  on  the  average  service  time  but  also  on  the 
variability  in  service  time.  If  variability  is  reduced  even  though  average  throughput 
is  not,  then  the  mean  queue  length  gets  shorter! 


Question  4.8 

(i)  Use  Result  (4.5)  to  find  the  mean  length  for  the  M/M/1  queue. 

(ii)  Find  px  for  the  M/U/l  queue,  where  T ~  U( 0,2/e),  and  for  the  M/T/l  queue, 
where  T  ~  T(n,  ns).  □ 


This  is  a  suitable  point  at  which  to  watch  Band  E  of  the  video-cassette.  It  covers 
graphical  representations  of  the  M/M/1  and  M/D/1  queues  for  different  values  of 
the  traffic  intensity  p. 


mvr»i 

20 


5  Variation  and  generalization 


The  queues  we  have  been  looking  at  in  the  preceding  sections  are  further 
variations  on  the  general  theme  of  a  (Markov)  birth  and  death  process,  which  may 
be  written: 

P(X(t  +  dt)  =  x  +  1 1  X(t )  =  x)  =  px,x+l(t,  t  +  dt) 

=  fix  dt  +  o(St), 

P(X(t  +  5t)  =  x-  1 1  X(t)  =  x)  =  px>x_  i(f,  t  +  dt) 

=  vxdt  +  o(St). 

Some  familiar  examples  are  the  Poisson  (arrival)  process  (fix  =  A,  vx  =  0),  the 
simple  birth  process  (fix  =  fix,  vx  =  0)  and  the  simple  birth-death  process 
{fix  =  fix,  vx  =  vx). 

In  this  unit  we  have  considered  for  the  first  time  an  emigration  component,  which 
comes  into  the  model  for  the  M/M/1  queue.  A  queue  with  ‘ample’  servers,  the 
M/M/ oo  queue,  is  also  part  of  the  birth  and  death  family  —  actually  immigration- 
death,  in  the  language  of  Unit  8: 

M/M/1 :  £X  =  A,  vx  =  e; 

M/M/  oo :  px  =  A,  vx  =  xs. 

Question  5.1  Specify  the  M/M/n  queue  as  a  birth  and  death  process.  (That  is, 
evaluate  /?x  for  x  =  0,  1,2,...,  and  vx  for  x  =  1,2,  3, . . . ,  so  that  they  correspond 
exactly  to  the  model  developed  in  Subsection  3.1.)  □ 

In  general,  our  analyses  of  (Markov)  birth  and  death  processes  have  taken  the 
form: 

— specify  the  parameters  [lx  and  vx; 

— write  down  the  differential-difference  equations  for  {px(t)}; 

— derive  a  partial  differential  equation  for  n(s,  t ); 

— solve  that  partial  differential  equation  using  the  initial  condition  X(0)  =  x0; 
and,  sometimes, 

— find  conditions  for  an  equilibrium  distribution  to  exist; 

— identify  the  equilibrium  distribution. 

The  sort  of  question  to  which  it  is  then  interesting  or  useful  to  find  the  answer 
depends  on  the  context  —  we  might  speak  of  ‘population  size’,  ‘queue  length’  or 
‘the  state  of  the  process’;  or  of  ‘lifetime’,  ‘repair  time’  or  ‘waiting  time’;  or  of  ‘dead 
or  alive’,  ‘off  or  on’  or  ‘idle  or  busy’. 

While  it  is  often  instructive  to  derive  the  exact  probability  distribution  of  the 
random  variable  X(t),  it  is  not  always  easy  —  where  it  is  easy,  we  have  done  so. 
Alternatively,  one  can  go  straight  to  the  equilibrium  distribution,  descriptive  of  the 
process  after  a  long  time.  As  you  have  seen,  this  distribution  does  not  always  exist, 
because  the  process  explodes. 

It  would  be  very  useful  if  we  could  find  a  rule  for  existence  of  the  equilibrium 
distribution  in  the  general  case;  and  if  we  could  develop  a  method  which  would 
give  us  that  distribution  more  or  less  immediately. 


5.1  Equilibrium  theory 

The  equations  for  finding  the  equilibrium  distribution  of  the  general  (Markov) 

birth  and  death  process  arise  by  setting  pjt)  equal  to  zero  in  the  differential- 
difference  equations  (1.1): 

d 

JtPx(t)  =  Px-iPx-i(t)  +  vx+lPx+i(t)  -  (fix  +  vx)px(t),  x  =  0,1,2,.... 

Then  by  writing  lim  px(t)  as  px  and  rearranging  the  equations,  we  have 

i 

Px+1  =^—  ((Px  +  vx)px- Px-iPx-i),  x  =  0,1,2  ... .  (5.1) 


x  +  1 


Since  v0  —  0  and  /?_x  —  0  (by  definition),  we  can  write  tb  ;  recurrence  relation 
explicitly  as 

Pi  =  —Po, 

Vl 

1 

Px+  1  “  {(Px  T  Vx)Px  Px-  1  Px-  l)>  X  =  1,  2,  ...  . 

'x  + 1 


Question  5.2  Show  that 

PoPi 


,  P0P1P2 

P  2= - Po  and  p3  =  KOK1F2Po.  n 


Vl  V 


1  v  2 


v1v2v3 


The  pattern  is  quite  evident:  in  general,  the  recurrence  relation  (5.1)  gives 

PoP iP 2  •  •  •  Px  —  1 


Px  = 


Po,  x  1,2,...  . 


V1V2V3  •  •  •  Vx 

Writing  the  coefficient  of  p0  as  px  and  defining  p0  to  be  equal  to  one,  we  have 


(5.2) 


The  sequence  {p0,  plt  p2, ...}  defines  a  probability  distribution  only  as  long  as 
Po  T  Pi  +  P2  +  . . .  =  PoiPo  +  Pi  +  P2  +  •  •  •) 


CO 


=  Po  Z  Pi 

j—0 

=  1. 


00 


This  requires  that  £  pj  should  converge;  as  long  as  it  does,  then,  setting 


00 


j  =  0 


K  =  Y,  Pj  so  that  pQ  =  l/K,  we  have 
j= 0 

Px  =  ^Px,  X  =  0,1,2,.... 


Example  5.1  The  M/M/1  queue 

In  this  case  /ix  =  A  for  x  =  0,  1,  2,. 
these  values  in 


. ,  and  vx  =  e  for  x  =  1,  2,  3,  . . .  .  Substituting 


Px  = 


_  PoPl  ■  • • Px- 1 


v1v2...v 


gives 


Px  = 


X 


00 


in  other  words,  px  =  px.  Then  K  =  Y  Pj 

j=o 

p  <  1,  in  which  case  it  converges  to  1/(1  — 

Px  =  (l~p)px,  x  =  0,  1,  2,..., 
as  we  have  already  found.  □ 


00 


=  Y  Pj  and  this  is  convergent  only  if 
j= 0 

p);  and  if  this  is  so,  then 


v 


Of  course,  p  >  0. 
Subsection  2.1 
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Example  5.2  The  M/M/w  queue 

Here, 

1*  =  A,  x  =  0,  1,2,..., 

and 


v_  = 


x£  x  =  1,  2, n  —  1 
ne  x  =  n,  n  +  1,. . .  . 


Thus, 


Px  = 


loli  •  •  •  lx-  1 
ViV2...Vx 


m 


x\ 


nn  x(X/s): 


n! 


x  =  1,  2, . . . ,  n  —  1 


x  =  n,  n  +  1,. 


and 


K=  1+  Z 


""‘(A/e)*  ,  (A/£)"  ®  AaY 


+ 


n!  jJoVwe 


=  i  x! 

This  converges  only  when  X  <  ns.  □ 


5.2  Other  Markov  queues 

The  approach  just  described  can  be  applied  to  any  queueing  situation  (or  any  birth 
and  death  process,  for  that  matter)  where  the  parameters  /?x  and  vx  are  properly 
defined. 

(a)  Queues  with  discouragement 

We  have  all  suffered  the  experience  of  arriving  at  a  service  point  only  to  discover 
that  the  queue  is  very  long  indeed.  Sometimes  it  is  so  long  that  we  simply  turn 
away.  Suppose  that  the  sight  of  a  queue  already  containing  x  persons  is  such  that 
the  probability  that  a  new  arrival  stays  to  queue  is  only  l/(x  +  1).  Then 

2 

B  = -  y  =  o  1  2 

Hx  Y-f-]5  ’ 

Vx  =  £,  X  =  1,2,...  . 

Question  5.3  Find  px  and  hence  the  probability  distribution  {px},  stating  clearly 
what  conditions  on  the  parameters  X  and  e  are  necessary  for  the  probability 
distribution  to  exist.  □ 

Question  5.4  Suppose  that  arrivals  turn  up,  as  usual,  at  rate  X,  but  that  the 
probability  that  a  new  arrival  stays  to  queue  if  he  finds  x  people  already  in  the 
queue  ahead  of  him  is  only  a*,  where  0  <  a  <  1.  Writing  the  ratio  A/e  as  p,  show 
that  the  equilibrium  distribution  has  probability  function 

px  oc  px a(*~ 1)x/2,  x  =  0,  1,2,..., 

and  state  any  restrictions  on  the  arrival  rate  X  for  the  existence  of  this  probability 
distribution.  □ 

(b)  Finite  waiting  room 

Sometimes  people  cannot  wait  because  there  is  no  room  to  do  so.  If  the  waiting 
room  is  of  finite  capacity  c,  say,  so  that  the  queue  can  accommodate  at  most  c  +  1 
individuals  (one  being  served  and  c  sitting  waiting),  then 

x  =  0,  1,  2,...,c 
x  =  c  +  1,  c  +  2,... 


X/(ne)  >  0 


* 
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Question  5.5  Obviously  the  queue  size  can  never  be  greater  than  c  4-1.  Show  that 
when  X  ^  e,  the  limiting  probability  distribution  for  queue  size  is 

_ _ pV  -  p)  ..  A  ,  A 

Px  —  J  pc  +  2'>  ^  —  0,  1,  2, . . .  ,  c  +  1, 

where  p  =  X/&,  and  that  this  probability  distribution  exists  whatever  the  relative 
values  of  X  and  e.  □ 

Question  5.6  What  is  the  equilibrium  distribution  if  p  =  1?  □ 

We  have  looked  at  only  the  steady-state  dynamics  of  these  modified  queues;  this 
does  not  mean  that  it  is  not  possible  to  make  progress  with  the  exact  distribution 
theory  which  follows  from  the  differential-difference  equations  for  the  probabilities 
{Px(t)j,  but  it  is  usually  rather  difficult! 


5.3  Final  comments 

In  this  unit  we  have  concentrated  attention  on  the  congestion  problem  applied  to 
three  main  queueing  models.  The  first  two  are  the  M/G/\  queue  and  the  M/M/n 
queue  (both  of  which  have  M/M/1  as  a  special  case).  A  system  covering  all  of  these 
is  the  M/G/n  queue,  but  this  model  raises  mathematical  difficulties  beyond  the 
scope  of  the  course.  The  third  area  deals  with  simple  Markov  queueing  models 
expressible  in  terms  of  the  general  birth  and  death  process  indexed  by  the 

parameters  (ix,  x  =  0,  1,  2,...,  and  vx,  x  =  1,  2,  3, ...  .  Again,  the  M/M/n  queue  is 
a  special  case. 

Other  than  to  point  out  the  difficulties  associated  with  analyses  which  incorporate 
the  time  element,  we  have  not  really  bothered  with  these  at  all,  preferring  the  more 
informative  equilibrium  models. 

Nothing  at  all  has  been  said  about  queues  with  other  than  random  arrival 
mechanisms,  and  this  means  in  particular  that  the  common  and  important  cases  of 
an  appointment  system  with  model  specification  D/M/ 1,  say,  or  more  generally, 
D/G/n,  have  been  omitted. 

The  model  on  which  it  would  probably  be  most  rewarding  to  spend  some  time  is 
D/G/l,  as  the  multi-server  appointment  system  usually  involves  an  appointment 
with  a  particular  server  anyway,  not  the  one  you  would  happen  to  end  up  with 
from  a  central  queue.  The  model  is  quite  well  understood,  and  not  too  difficult, 
but  it  does  not  feature  in  this  introduction  to  queueing  theory. 


Objectives 


After  studying  this  unit  you  should  be  able  to: 

use  queue  notation  of  the  style  M/G/n  to  identify  and  to  specify  the  arrival 

mechanism,  service  time  distribution  and  number  of  servers  in  a  given  queueing 
model; 

recognize  when  a  given  queueing  model  can  be  regarded  as  a  special  case  of  the 
general  birth  and  death  process; 

set  up  (but  not  necessarily  solve)  a  partial  differential  equation  for  the  probability 
generating  function  If(s,  t )  of  queue  size  at  time  t  for  a  given  queueing  model; 

establish  conditions  for  an  equilibrium  queue  size  probability  distribution  to 
exist  —  and,  when  it  exists,  find  it; 

answer  questions  about  the  mean  queue  size  for  a  single-server  queue  with  random 
arrival  mechanism  and  general  service  time  distribution. 
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Appendix:  Solutions  to  questions 


Section  1 

l.l(i)  Customers  arrive  at  random,  so  the  inter-arrival 
distribution  is  exponential:  M.  The  service  time  is  constant: 
D.  There  is  a  central  queue  for  two  ‘servers’.  The  queue  is 
denoted  M/D/ 2. 

(ii)(a)  Customers  arrive  at  random  at  a  place  where  there 
are  six  servers  on  duty.  The  time  taken  to  complete  a  service 
is  uniformly  distributed. 

(b)  Customers  arrive  at  equally-spaced  intervals  (for 
instance,  punctually  according  to  a  regular  appointment 
system)  and  there  are  two  servers  on  duty.  The  time  each 
server  takes  with  a  customer  is  constant. 

1.2  The  queue  size  increases  with  each  random  arrival. 
This  is  the  only  way  in  which  ‘births’  occur,  so  (ix  =  A  for 
x  =  0,  1,  2, ...  .  On  the  other  hand,  the  queue  size  decreases 
with  each  departure  —  as  long  as  x  >  1  —  so  vx=  e.  If  the 
queue  is  empty,  then  there  is  nobody  there  to  be  served: 
v0  =  0  (as  defined  in  Unit  8). 


Section  2 


2.1  Equation  (2.1a)  can  be  rewritten 
ZPx+l  =  (A  +  £)px  -  lpx-l5 
and  so 

A\  A 
-e)P*-eP*-' 

=  (1  +  P)Px  -  PPx-  1- 
We  know  that  px  =  pp0.  So 

P2  =  (1  +  P)P\  -  PPo 
=  (1  +  p)pp0-  PPo 

=  P2Po 
and 


P3  =  (1  +  P)Pi  ~  PP 1 
=  (1  +  p)P2Po  ~  P2Po 
=  P3Po- 

A  reasonable  guess  at  the  probability  distribution  based  on 
these  results  for  py,  p2  and  p3  is 


Px  =  PxPo ,  x  =  0,  1,  2,...; 

and  substituting  this  into  Equation  (2.1a)  verifies  this 
proposition: 


zpx+  Vo  -  (A  +  £)pxPo  +  Ap*  Vo 


=  P  o 
=  0, 


A 


x+  1 


A 


JC+1 


e- 


as  required. 


A*  A*  \ 

e*“ 1  +  ex~1J 


2.2  From  Formula  (2.2), 

P0  +  P1+P2  +  ...  =  Po  (1  +  p  +  p2  +  ...), 

which  converges  only  if  0  <  p  <  1,  to  p0/(l  —  p).  Thus, 

0  <  p  <  1  is  the  condition  for  the  equilibrium  distribution 
to  exist. 

Then  it  follows  that  p0  —  1  —  p  and,  finally,  that 

Px  =  V-p)px,  x  —  0,  1 ,  2,..., 

which  is  geometric,  G0{p).  The  server  is  idle  as  long  as  there 
is  nobody  in  the  queue,  the  probability  of  which  is 
Po  —  1  —  P\  thus,  he  is  idle  a  proportion  (1  —  p)  of  the  time. 
The  mean  of  this  geometric  distribution  is  p/(l  —  p),  and  this 
is  the  average  queue  length. 


2.3(i)  The  arrival  rate  is  1  per  12  minutes,  or  5  per  hour. 
The  service  rate  must  be  faster  than  this  if  the  queue  is  to 
attain  equilibrium,  and  so  the  average  service  time  must  be 
less  than  12  minutes.  Otherwise,  the  queue  ‘explodes’. 

(ii)  If  the  average  service  rate  is  1  per  8  minutes,  or  1\  per 
hour,  then  the  traffic  intensity  is  p  =  A/e  =  5jl\  ==  f,  which  is 
less  than  one.  The  counter  clerk  is  idle  a  proportion 

Po  =  1  —  p  =  ^  of  the  time. 

(iii)  The  average  queue  length  is  p/(l  —  p)  =  §/(l  —  §)  =  2. 

(iv)  The  probability  that  the  queue  size  exceeds  2  is 
P(X  >  2)  =  1  -  p0  -  Pl  -  p2 

=  1  -t-m-w 

=  &  =  0.2963. 

2.4  On  average,  a  new  customer  arrives  as  frequently  as 
the  server  processes  a  customer;  any  idle  period,  however 
brief,  leads  to  a  backlog  of  queueing  customers.  (Put 
mathematically,  the  term  ‘steady-state’  requires  that  the  zero 
state,  when  the  queue  is  empty,  should  be  positive  recurrent. 
This  is  so  if  p  <  1.  When  p  —  1,  the  zero  state  is  null 
recurrent.) 

2.5  Over  the  long  time  period  of  duration  £2,  the  expected 
number  of  arrivals  is  AQ.  The  expected  number  of  busy 
periods  is  A(1  —  p)£l,  so  the  expected  number  of  customers 
served  during  a  busy  period  is 

Afl  1 

A(1  —  p)Q  1  —  p' 


Section  3 


3.1  When  the  number  of  customers  in  the  queue  is  n  or 
more,  the  servers  are  all  busy,  and  the  exit  rate  attains  its 
maximum  value  ne.  Thus  fix  =  A,  vx  =  m,  and  substituting 
these  values  in  the  Kolmogorov  forward  equations  gives 

JtPx(t)  =  APx-i(t)  +  nzpx+i(t)  ~  (A  +  n£)px(t), 
x  =  n,n  +  1,...  . 


3.2  You  are  given 


r 


Px  =  < 


n\  \  he 


and  wish  to  verify 
A 

P  i  =  -Po. 

o 


x  =  1,  2,.. .,n  —  1 
x  =  n,  n  +  1,... 


(1) 

(2) 


Px+  1  = 

1 

e(x+  \  +  X£)Px~  Wx-i)  x  =  1,2, ... ,n  1 

I  1 

—  ((A  +  m)px  —  Xpx_  t)  x  =  n,  n  +  1 , . . .  . 

^  /to 

Using  Equation  (1),  the  left-hand  side  (LHS)  of  Equation  (2) 
is 


1  A 

P'  =  V.-£P° 

A 

=  RHS  of  Equation  (2). 


■f. 
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For  x  =  1,  2 1,  using  Equation  (1),  the  LHS  of 
Equation  (3)  is 

+ 1 


Px+l  = 


1 


(x  +  1)!  \8 
and  the  RHS  is 


P  o 


1 


e(x  +  1) 


-  i 


P  o 


1 


A 


+ 1 


P  0 


(x  +  1)!  \£ 

=  LHS. 

For  x  =  n,  n  +  1,...,  using  Equation  (1),  the  LHS  of 
Equation  (3)  is 

\X  +  1 

Po 


nn  A 

Px+ 1  =-:  — 
nl  \ne 


and  the  RHS  is 
1 


ns 


(A  +  «e)^(-)p0-A^(-T  p0 

nl  \ne )  nl  \ns J 


n”  f  A  \ 
n!\ne/ 

=  LHS. 

To  define  a  probability  distribution  it  is  necessary  that  the 
sequence  p0,  pl5  p2>...  should  sum  to  one.  Now 

Po  +  Pi  +  Pz  + 


Vc+  1 


=  Po 


(A/e)2  (A/e)3 

1  +A/e  +  M^-  +  MrA  +  ... 


2! 


3! 


(A/ey1  (A/e)"/  -  /  A. 

(«-!)!  n\  Vjto  W, 

which  is  convergent  only  if  the  term  £  (A/ne)7  converges.  This 
requires  that  A  <  ns. 

3.3(i)  The  general  results  (3.4)  for  the  M/M/n  queue  reduce 
for  the  M/M/2  queue  to 


Px=  < 


1  2* 

K x\P  X  =  0A 


KP 


x  —  2, 3, ... , 


where,  from  Equation  (3.5), 

(2p)2 


K  =  1  +  2p  + 


2(1  -  p) 


1  +  P 
1-P* 


as  required. 


Then 


1  1  -  p  2(1  -  p) 

Po  i  .  »  Px  7  7  P  i  ^  1,2,...  . 

A-  1  +  P  1  +  P 

(ii)  The  probability  generating  function  of  X  is 

n(s)  =  P0  +  P1s  +  p2s2  +  ... 

1  -  P 


1  +  2  (ps  +  (ps)2  +  (ps)3  +  . . .) 

1+  2pS 


1  +  P 
1  ~  P 

1  +  P  V  1  —  ps 
(1  -  p)(l  +  ps) 


(1  +  p)(l  -  ps)' 

(iii)  From  this  it  follows  that 


n'(s)  =  l — £  x 


2p 


1  +  P  (1  —  ps)2’ 
and  setting  s  equal  to  1,  we  find  that  the  mean  queue  length 


is 


P  =  n'(i)  = 


2  P 


1  -P 


3.4  Using  the  Theorem  of  Total  Probability, 
«(w)  =  Z  ^(w  I x  =  x)  P(2f  =  x) 


.x  =  ri 


=  E 


00  +  x-n 


'(ne) 


1 


rt 


x  =  n 


(x  —  n)! 
by  Equations  (3.4)  and  (3.7), 


x  k  x  l&r- 


1  n" 

=  KXn\m'e 


—  new 


“  wJC“"(ne)x_"  x 
L  —r. — T^i—P 


=  n  ~  «)! 

Making  the  change  of  variable  j  =  x  —  n,  this  reduces  to 


1  nn 
KXrin£e 


—  riEW 


y  (new)7'  ■_  1  n" 

L  •••  P  ~KXn\ 


i= o  J 


me~nsw  pn  entwp 


=  l  ns{npr  _p)w 

K  nl 


Section  4 

4.1(i)  If  the  queue  is  empty  at  time  t,  then  the  number  in 
the  queue  at  time  t  +  1/e  is  0  +  A  =  A,  where  A  ~  Poisson(p) 
is  the  number  of  arrivals  in  the  time  interval  [t,  t  +  1/e].  The 
first  of  these  (if  any)  will  be  being  served  at  time  t  +  1/e,  but 
will  not  yet  have  left  the  queue. 

(ii)  If  the  queue  is  of  size  n  at  time  t,  then  at  time  t  +  1/e 
one  of  these  customers  will  have  left.  So  the  size  of  the  queue 
at  time  t  +  1/e  is  n  —  1  +  A,  where  A  ~  Poisson(p). 

4.2  If  there  are  0  or  1  customers  in  the  queue  at  time  t, 
then  there  will  be  x  customers  in  the  queue  at  time  t  +  1/e 
only  if  there  are  exactly  x  arrivals  in  the  interval:  the 
probability  of  this  is 

P{A  =  x)  =  e~p£ 

x! 

If  there  are  n  customers  in  the  queue  at  time  t  ( n  >  1),  then 
there  will  be  n  —  1  left  at  time  t  +  1/e,  and  so  x  customers  in 
the  queue  altogether  at  time  t  +  1/e,  only  if  A  =  x  -  (n  -  1). 

If  the  queue  size  at  time  t  exceeds  x  +  1,  then  it  is  not 
possible  for  the  queue  size  to  be  x  at  time  t+  1/e.  We  have 

px(t  +  1/e)  =  e~p(^(p0(t)  +  Pi(t))-^PX  +  p2(0^  jjjP*1  +  " 

...  +  px(t)p  +  px+l(t )^. 

4.3(i)  Multiplying  each  of  Equations  (4.1)  in  turn  by  s°,  s1, 
s2, . . . ,  we  obtain 

Po  =  e~p(Po  +  Pi), 

Pis  =  e~p((p0  +  Pi)ps  +  p2s), 

p2s2  =  e~p((Po  +  pJipV  +  p2ps2  +  p3s2), 

p3s3  =  e~p((p0  +  Pi)ip3s3  +  p2ipV  +  p3ps3  +  p4s3), 

Summing  over  all  x  >  0,  we  obtain  on  the  left-hand  side 

oo 

Z  Pxs*  =  n(s);  and  on  the  right, 

x  =  0 

e~P{(Po  +  Pi)(l  +  ps  +  \p2s2  +  ip3s3  +  . . .) 

+  p2s(l  +  ps  +  \p2s2  +  £p3s3  +  . . .) 

+  p3s2(l  +  ps  +  -|p2s2  +  £p3s3  +  . . .) 

+  ...) 

=  e~peps(p0  +  Pi  +  p2s  +  p3s2  +  ...). 

Thus, 

H(s)  =  e~pil~s){p0  +  px  +  p2s  +  p3s2  +  ...). 
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(ii)  This  can  be  simplified  to 


I7(s)  =  e 


—  e~p^  -s) 


Po  +  ~iPiS  +  p2s2  +  P3S3  +  ...) 

** 

Po  +  ^  (n(s)  -  Po)^- 


(iii)  Hence 


n(s)(  1  -ig-pa-o^g-pa-^poh  _i)3 


giving 


n(s)  = 


g-pa-sjpo^i  _  A 

1  _ie-P(i -•> 

5 


Multiplying  numerator  and  denominator  by 
obtain 


sep(1  «>  we 


m  = 


U  -  s)p0 

1  -sep(1~s)‘ 


4.4  Using  Po  =  e  P(p0  +  px),  it  follows  that 

Pi  =  Po(ep  -  i); 
but  po  =  1  —  p,  so 

Pi  -  (1  -  p)(ep  -  1). 

Then,  using  px  =  e~p((p0  +  px)p  +  p2),  it  follows  that 
p2  =  Pxep  -  (p0  +  pjp 

=  (1  -  p)(ep  -  \)ep  -  (1  -  p)epp 
=  (1  -  P)ep(ep  -  p  -  1). 

Finally,  using  p2  =  e~p({p0  +  p^p2  +  p2p  +  p3),  it  follows 
that 

p3  =  p2ep  -  (p0  +  PiHp2  -  p2p 

=  (1  -  p)ep(ep  -  p  -  l)(ep  -  p)  -  |p2(  1  -  p)ep 
=  (1  —  p)ep(e2p  —  2  pep  +  p2  —  ep  +  p  —  ^p2) 

-  (1  -  p)ep{e2p  -  (1  +  2 p)ep  +  (p  +  ip2)). 


4.5  For  the  M/M/1  queue, 
following. 

Px  =  (1 

—  p)px.  This  gives  the 

P 

0.2 

0.5 

0.8 

Po 

0.8 

0.5 

0.2 

Pi 

0.16 

0.25 

0.16 

P2 

0.032 

0.125 

0.128 

P3 

0.0064 

0.0625 

0.1024 

For  the  M/D/1  queue,  using  Solution  4.4,  we  find  the 
following. 

P 

0.2 

0.5 

0.8 

Po 

0.8 

0.5 

0.2 

Pi 

0.1771 

0.3244 

0.2451 

Pi 

0.0209 

0.1226 

0.1894 

Pi 

0.0018 

0.0378 

0.1276 

You  may  have  noticed  the  following.  (It  does  not  matter  if 

you  did  not;  one  has  to  know  what  one  is  looking  for  in  the 
first  place.)  For  a  given  traffic  intensity  p,  the  M/M/ 1  queue 
is  more  likely  to  be  long  than  is  the  M/D/1  queue  with  the 
same  p:  for  instance  (in  a  slightly  free  notation)  for  p  =  0.8 
we  have  the  following. 


X 

P(M/M/1  >  x) 

P(M/D/1  >  x) 

0 

1 

1 

1 

0.8 

0.8 

2 

0.64 

0.5549 

3 

0.512 

0.3655 

4 

0.4096 

0.2379 

(If  for  two  random  variables  X  and  Y  it  is  the  case  that 
P(X  >  z)  >  P(Y  >  z)  for  all  z  (i.e.  X  is  ‘more  likely’  to  be 
large),  then  X  is  said  to  be  stochastically  greater  than  Y.  It 
appears  from  these  particular  calculations  that,  for  a  given 
traffic  intensity,  the  M/M/1  queue  is  stochastically  greater  (or 
not  stochastically  less)  than  the  M/D/ 1  queue.  In  fact,  it  can 
be  shown  formally  that  this  is  the  case.) 

4.6  Differentiating  with  respect  to  s  both  sides  of  the 
equation 

(1  —  sep(1_s))H(s)  =  (1  —  p)(l  —  s), 
we  obtain 

(1  -  sep{l  -S))n'(s)  -  (<?p(1-s)  -  spep(1~s))n(s)  =  -(1  -  p). 
Differentiating  again,  we  have 

(1  -  sep(1~s))n"(s)  -  2(ep(1-s)  -  spcp(1_s))n'(s) 

+  (2pcp<1  ~s)  -  p2sep(l  -S))n(s)  =  0. 

Now  setting  s  equal  to  1, 

on"(i)  -  2(1  -  p)n'(i)  +  (2  p  -  p2)n(i)  =  o. 

Since  n'(l)  =  px  and  n(l)  =  1,  this  implies  that 

_  2p  -  p2  _  p  -  \p2 
2(1  -  p)  1  -  p  ' 

Setting  s  equal  to  1  after  differentiating  only  once  would  give 
On'(l)  -  (1  -  p)II(l)  =  -(1  -  p), 
that  is,  n(l)  =  1,  which  is  true  but  not  useful. 


4.7  £(queueing  time) 

=  F^f^queueing  time|X)] 

00 

—  ]T  £(queueing  time  |  X  =  x)  P(X  —  x) 

=  E(queueing  time  \X  =  0)  p0 

00 

+  Yj  ^(queueing  time \X  =  x) P{X  =  x) 

x=i 

=  7(1—  P)+  t  7<x  +  i)P(2f  =  x), 

£  x=  1  £ 

since  E(U)  =  This  reduces  to 

i(i-p)+l^  +  2P(x>i) 


l,i  ,  1  p 


since  P(X  >  1)  =  1  —  p0  =  p, 


2-P 
2e(l  -  pY 


using  Result  (4.4), 


4.8(1)  For  the  M/M/1  queue,  T  ~  M(e),  so  V{T)  =  1/s2. 
Putting  this  into  Pollaczek’s  formula,  we  obtain 

P  ~  YP2  +  i22/a2 

^ 

p 

1  -p 
since  p  =  1/s. 

(ii)  If  T  ~  [7(0, 2/e),  then  V(T)  =  l/(3e2).  It  follows  that 

p  -  y + hp2 

_p-  y 

i-p  • 


If  T  ~  T(n,  ns),  then  V(T)  =  1  /(ns2).  From  this, 


Px  = 


p-Sp2  +  sp 


2 


* 
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Section  5 


5.1  In  tli is  case, 

Px  =  ,  x  =  0,  1,  2,..., 

and 


xe  x  —  1 ,  2, . . . ,  n  —  I 
m  x  —  n,  n  +  1,...  . 


5.2  From  the  recurrence  relation, 

P2  =  +  v,)p,  -  PoPo) 

V2 

~  ~({^1  +  ^i)~~Po  PoPo 
v2  \  V, 


Ml 

ViV2 


P  0 


and 


P3  =  ~{(p2  +  v2)p2  -  /?lPi) 

V  -» 


V3  \  VjVj  V, 


P0P1P2 

V1V2V3 


P  0 


5.3  In  this  case, 

_  PoP\P2  •••  Px-  1 

r  x 

VlV2V3...Vx 

_  (A/1) (A/2) (A/3)  (A/x) 

£  £  e  8 

=  mi 

x\ 

00 

and  K  =  Z  (X/s)x/x\  =  exp(A/e)  is  convergent  whatever 

.v  =  0 

the  relative  values  of  X  and  e.  This  gives 
Px  =  KPx 


e~xl£(X/e)x 


x  =  0,  1,  2,...  . 


(The  equilibrium  queue  size  distribution  is  Poisson  with 
mean  X /&.  Idle  periods  are  guaranteed  however  high  the 
arrival  rate:  the  ‘putting  off  feature  acts  sufficiently  strongly.) 


5.4  Here  px  —  Xclx  and  vx  =  e  for  all  x.  Then  p 
where 

PoP  1 P2  Px-  1 


1 

KPx 


Px  = 


v^2v2...vx 

j|xa<)  +  1  +  2  + . . .  +  (x  —  1) 


_  pxa(x~  *  )xl2 

00  00 

and  K  =  Z  px  =  Z  Px a.(x~l)xl2.  Because  a  <  1,  this 

x  =  0  JC  =  0 

converges  for  all  values  of  p.  An  equilibrium  probability 
distribution  is  defined  whatever  the  arrival  rate. 


5.5  Using  Px  =  X,  x  —  0,  1,  2, . . . ,  c,  and  vx  =  e,  we  have 

Px  =  W&Y  =  Px,  x  =  0,  1., . . . ,  c  +  1; 
px  is  zero  otherwise.  Then 

c  +  1 

K=  Z  Px  =  1  +  P  +  P2  +  -  ■  -  +  PC+  U, 

x  =  0 


and  since  X  ^  e,  we  have  p  #  1,  so  that  K  is  equal  to 
(1  —  pc  +  2)/(  1  —  p).  This  yields 


( 1  ~  p)px 

1  -pc+2’ 


x  —  0,  1,  2, . . . ,  c  T  1 . 


5.6  If  p  =  1,  then  px=  1  for  x  =  0,  l,...,c  +  1,  and 
K  =  c  +  2.  The  equilibrium  queue  size  distribution  is 

Px  =  rr>  x  =  0,  1 ,  2, . . . ,  c  +  1 . 
c  +  2 

That  is,  the  queue  size  distribution  is  uniformly  distributed 
on  {0,  1,  2,...,  c  +  1}. 
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